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Description 

BACKGROUND OF THE INVENTION 

5 1 . Field of the Invention 

The present invention relates to a device for detecting the motion vector of an entire picture due to shake or swing 
of a video camera, in particular, by an image signal, and a device for correcting unnecessary swing of the entire picture 
due to shake or swing of video camera. 
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2. Description of the Prior Art 



A conventional image motion vector detecting device is disclosed, tor example, in the Japanese Laid-open Patent 
Sho. 61-269475. 

15 Fig. 1 is a block diagram of an image swing correcting device applying the conventional motion vector detecting 

device, in which numeral 201 is an image signal input terminal, 202 is a vector detecting circuit in each detecting region, 
203 is a correlation value detecting part, 204 is a vector detecting circuit of each region combining the vector detecting 
circuit 202 and correlation value detecting circuit 203, 205 is a vector reliability judging means, 206 is a motion vector 
determining means, and 207 is a swing correcting means. 

20 in thus composed conventional image motion vector detecting device, in the first place, an image signal continuous 

for at least two fields in time is fed into the input terminal 201 . In the vector delecting circuit 202 of each detecting 
region, as shown in Fig. 2, four vector detecting regions 209, 210, 211, 212 are preliminarily determined in a screen 
219, and each detecting region is divided into multiple subregions 215 having a representative point 217 (the number 
of vector detecting regions may be four or more). Concerning the representative point of each subregion, the difference 

25 from the signal of a position 218 deviated by the quantity of a specific range (ij):imin < i< imax, jmin < j < jmax between 
two fields is determined as the correlation value, and the sum of the subregions is obtained. The correlation value is 
calculated as follows. 



30 



Correlation value - 



2 I 



A L ! (i , j) 



35 where 

I A L I (i,j) : the absolute value of the difference of the signal between the coordinates (i,j) and representative 

point 

n : number of subregions in one detecting region 

40 

Detecting the deviation (i\j') for giving the minimum value of the correlation value, it is taken as a vector 21 3 of 
each detecting region. The correlation value detecting part 203 determines the minimum, mean and maximum of the 
correlation values, and delivers them, together with the motion vector value, to the vector reliability judging means 205 
and motion vector determining means 206. A detailed composition of the vector reliability judging means 205 is shown 

4 5 in Fig. 3. In the reliability judging means 205 the minimum, mean and maximum of the correlation values are fed into 
a comparator 220, and are compared with the predetermined set value Ref(the threshold level of judging condition) . 
In the comparator 220, for example, if the mean is lower than the set value, it is judged that the reliability is lacking 
(reliability = 0), and otherwise the reliability is confirmed (reliability = 1). In the motion vector determining means 206, 
the mean of the vectors in the region judged to be reliable from the minimum, mean and maximum of correlation values 

so of each region is delivered as being determined as the motion vector of the entire screen. Fig. 4 starts with step 221, 
and step 222 corresponds to step 204 in Fig. 1 , step 223 to step 205 in Fig. 1 , and step 206 to step 224 in Fig. 1 , and 
a motion vector is delivered at step 225. 

The swing correcting means 208 possesses an image signal storing means of one field or more, and by controlling 
the reading positions of these signals, when an image with a large fluctuation is fed as shown in 226, 227 in Fig. 5, the 

55 screen of the image is moved parallel from 229 to 226 in the direction 231 of correcting the fluctuation, on the basis of 
the motion vector 230 entered from the motion vector determining means 206, with respect to the input image signals 
of the n-1 -th field, the n-th field, and then enlargement of the screen or other operation is manipulated by interpolation 
or the like, thereby delivering image signals 232, 233 in a size of one screen less in fluctuation. 
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In the example explained above, the reliability of the vector is judged by the minimum, mean and maximum of the 
correlation values, but other methods are also known to judge the reliability, for example, by the difference between 
the minimum of the correlation values and its peripheral point value, that is, the inclination of the periphery of the 
minimum point, or by the value of the minimum alone, or by the state of the correlation values, 
s in the hitherto motion vector detecting device composed as described herein, the reliability is judged anyway by 

the present state of the correlation values such as the minimum, mean and maximum. However, since the correlation 
value at each time is unstable due to noise or the like, the reliability cannot be correctly judged by the correlation value 
at each time atone. 

Besides, as in the prior art, when judging on the binary basis (0 or 1 ) to determine the reliability by a predetermined 
io threshold level, it the reliability judgment in a certain range of the threshold level of the judging condition is ambiguous, 
in other words, if there is an uncertain region of reliability judgment in a width of w1 , w2 with respect to the threshold 
levels of condition 1 , condition 2 as shown in Fig. 6, the following case may be considered. Suppose there are two 
sets of data D1, D2 as shown in Fig. 6. Both D1 and 02 were obtained in the same condition, but were unstable due 
to noise or the like, and were obtained as different data. By nature, these two are same data, and are positioned at a 
is very close distance, but in the ambiguous region as for condition 2, and hence D1 is judged to be reliable, and D2 not 
reliable. As for condition 1 , however, the data D1.D2 belongs obviously to the reliable region. In this case, therefore, 
it is correct to judge that both D1 and 02 are reliable, but actually D2 is misjudged to be not reliable. 

Due to such cause, the motion vector detecting device of the conventional constitution often misunderstood that 
a moving object entered the screen although it was not actually or detected a vector added with the motion of a moving 
20 object when the moving object entered the screen. Therefore, the swing correcting device often malfunctioned as the 
screen was corrected in a wrong direction from the direction intended by the operator as the correction was interrupted 
or a vector added with the motion of the moving object was detected. 

In the conventional constitution of the motion vector detecting device, moreover, the motion vector detecting device 
often malfunctioned when a moving object entered the screen because the motion vector of the entire screen was 
25 judged from the result of the determination of the reliability in each region. That is, detection of a moving object is done 
independently in each region, a sufficient detecting performance of moving object cannot be obtained. 

This point is described in detail below. Fig. 7 (a) shows the time course variations of the correlation values when 
a moving object enters the screen, and Fig. 7 (b), when vibrations of a specific period are applied to a camera. The 
period indicated by T1 in Fig. 7 (a) is the period when the moving object is present, and the period indicated by T2 in 
30 Fig. 7 (b) is the time of applying vibrations to the camera. To distinguish the motion due to the moving object and the 
motion due to camera swing, the level of the correlation value is noticed, tn the case of the moving object, the correlation 
value increases largely due to invasion of the moving object, but the fluctuation of the correlation value is small in the 
case of camera swing. Accordingly, when the correlation value is larger than a certain level, it is regarded to be due 
tothe moving object, and the reliability is judged to be absent. Depending on the circumstances, however, the correlation 
3S varies very little due to moving object or the correlation varies very much due to camera swing, and then it is difficult 
to correctly judge the two in each region. 

Incidentally, such point that when a moving object enters the screen, the motion vector added with the motion of 
the moving object is detected, is described in detail below. In this case.the swing correcting device often malfunctions 
by correcting the screen in a wrong direction from the direction intended by the operator. 
40 Referring now to the drawings, this is explained more specifically. As shown in Fig. 64, while the video camera is 

stopped still, suppose a moving object 52 passes through the screen. First, as shown in interval (a) in Fig. 64, when 
the background and the moving object coexist within a certain detecting region 48 ,this detecting region 48 is judged 
to be not reliable by the state of correlation value 53. On the other hand, the still background in a detecting region 49 
is desired to be judged reliable by reliability judging means , but depending on the screen appearance of the back- 
45 ground, it may be misjudged to be not reliable as the correlation value 54. 

Next, as shown in interval (b) in Fig. 64, when occupying the majority of the detecting region 48, the motion vector 
expressing the motion of the moving object is detected from that detecting region, and a smaller value 55 than the 
specified value is indicated by the correlation value 53, and the reliability judging means judges reliable. Besides, the 
background of the detecting region 49 is still judged to be not reliable, and as a result the motion of the moving object 
50 is employed as the motion vector of the entire screen, and when the swing is corrected on the basis of this, the still 
background is moved, which results in an unnatural image (the operation of the detecting regions 50, 51 is same as 
that of 48, 49, respectively, and is not explained herein.). 

Fig. 8 shows the vector of each detecting region and the motion vector of the entire image at this time. A vector 
234 corresponds to the vector of the moving object of 52 of Fig. 64, a vector 235 to the vector of the detecting region 
5S of 48 of Fig. 64, a vector 236 to the vector of the detecting region of 49 of Fig. 64, a vector 237 to the motion vector of 
the entire screen, and a vector 23B to the vector of the background. Intervals (a) to (e) in Fig. 1 8 correspond to intervals 
(a) to (e) in Fig. 64. The motion vector detected in intervals (a) to (e) in Fig. 64 is as shown by 237 in Fig. 8, and when 
the swing is corrected on the basis of this vector, an abnormal correction occurs suddenly in the state of interval (b) tn 
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Fig. 8. Furthermore, the vector due to the camera swing may be added to alt vectors in Fig. 6, and an abnormal 
correction may occur due to the same reason. 

in the conventional motion vector detecting device, still more, when the screen is swinging and it is being corrected, 
the reliability judging means suddenly judges not reliable depending on the screen appearance, and 0 vector is often 
5 delivered from the vector determining means. As a result, the swing correcting device does not function, and the screen 
shows a swinging, hard-to-see image. 

Practical examples are described below by reference to Figs. 71 and 9. Fig. 71 shows the screen before correction 
expressing the camera swing, detecting regions 75, 77, their correlation value 80, detecting regions 76, 78 and their 
correlation value 81 ( the action of the detecting regions 77, 78 is same as that of 75, 76, respectively, and is not 
10 explained .)- Numeral 79 is an obstacle. To begin with, in intervals (a) and (c) in Fig. 71, depending on the state of the 
correlation values 80, 81 , the reliability is affirmatively judged in the detecting regions 75, 76, and swing may be cor- 
rected normally. In interval (b) in Fig. 71 , however, depending on the state of the correlation values 80, 81 , the detecting 
regions 75. 76 are suddenly judged to be not reliable, and the motion vector of the entire screen becomes 0 by the 
vector determining means, and the swing correction is stopped. Finally, as shown in interval (d) in Fig. 71 , when both 
is background and moving object are present in a certain detecting region 75, depending on the state of the correlation 
value 80, the detecting region 75 is judged to be not reliable. On the other hand, the background of the detecting region 
76 is judged to be reliable by the reliability judging means, and the motion of the background is employed, and only 
the screen swing is corrected, and a normal motion is achieved. 

Fig. 9 shows the motion vector of the intervals in Fig. 71. In Fig. 9, numeral 241 is a motion vector of the camera, 
20 which swings, vertically about 0 vector. Numeral 240 is a vector detected Irom a detecting region 75, and a motion 
vector 241 due to camera swing , a motion vector of the moving object 79 in Fig. 71 or other wrong vector is detected. 
Numeral 239 is a vector detected from a detecting region 76, and a motion vector 241 due to camera swing is detected. 
A vector 242 is a motion vector of the entire screen delivered from a vector determining means 206 in Fig. 1. The 
intervals (a) to (d) in Fig. 71 correspond to the intervals (a) to (d) in Fig. 81. Same as in Fig. 71, in interval (b), the 
25 vectors 239, 240 in the detecting regions become 0, and the motion vector 242 of the entire screen is also 0. As a 
result, suddenly, the swing is not corrected, and the screen shows a swinging, hard-to-see image. 

In the case of multiple vector detecting regions, malfunction of vector detection when a moving objects enters the 
screen is explained below. 

As shown in Fig. 1 0 (a), (b), suppose a moving object (a car) 246 passes through the screen while the video camera 

30 js swinging. Numeral 243 is a detecting region, 244 is a motion vector of the background, and 245 is a motion vector 
of a moving object. The background is judged to be reliable by the reliability judging means, and the correlation value 
249 shows a smaller value 250 than the specified value. While the background and moving object coexist, since the 
correlation value 252 does not possess the specified minimum value, and its detecting region is judged to be not reliable 
(the shaded area in Fig. 10). When the motion of the moving object has occupied the majority of the detecting region, 

35 the motion vector 245 expressing the motion of the moving object is detected from that detecting region, and the 
correlation value 247 shows a smaller value 248 than the specified value, and the reliability is affirmatively judged by 
the reliability judging means. As a result, both the motion of the moving object and the motion of the background are 
employed as the motion vectors of the entire screen, and when the swing is corrected accordingly, since the motion 
of the moving object is contained, an unnatural image is produced. 

40 The JP-A-61 -269475 relates to a moving vector detection system and shows to calculate a vector of divided screens 

according to a correlation value. A correlator calculates the correlation between an image information of the current 
frame inputted to an input terminal an an image information of the representative point of the last frame from a latch 
circuit. A correlativity effective/ineffective decision circuit decides whether or not a candidate vector of each divided 
image surface is effective or not on the basis of a correlative value outputted from an integrating adder and outputs a 

45 decision signal to a decision circuit. The decision circuit calculates a dynamic vector according to a correlative value 
obtained among remaining divided image planes and corresponding to a deviation on the basis of the decision signal 
without using a correlative value obtained relating to a divided image surface whose candidate vector is juedged to be 
ineffective. 

The US 4 667 233 shows an apparatus for discriminating a moving region and a stationary region in a video signal. 

so 

SUMMARY OF THE INVENTION 

To solve the above problems, the invention presents the following constitution. 
An image motion vector detecting device of the present invention comprises; 

means for determining a correlation value in a specific deviation in each detecting region of plural detecting regions 
disposed in a screen, 

means for determining a motion vector in each detecting region by the correlation values, 
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reliability judging means for judging a reliability of motion vector of detecting region by the value of motion vector 
or the correlation value or their combination, 

minimum judging means for judging a motion vector having a relatively small value among the motion vectors of 
detecting regions, 

5 means for leading out a final judgment resu It from the minimum judging means and the reliability judging means, and 

means for determining a motion vector of an entire screen from the motion vector of each detecting region the 
basis of the obtained final judgment result. 

In the image motion vector detecting device of the present invention; 
10 the minimum judging means judges only one minimum value among the motion vectors of detecting regions. 

An image motion vector detecting device of the present invention comprises; 

means for determining a correlation value in a specific deviation in each detecting region of plural detecting regions 
disposed in a screen, 

is means for determining a motion vector in each detecting region from the correlation values, 

state judging means for judging a state of motion vector of detecting region by the value of motion vector or the 
correlation value or their combination , 

similarity judging means for judging a similarity of motion vectors of detecting regions, 

means for leading out a final judgment result from the similarity judging means and the state judging means, and 
20 means for determining a motion vector of an entire screen from the motion vector of each detecting region on the 

basis of the obtained final judgment result. 

In the image motion vector detecting device; 
the state judging means is a reliability judging means for judging a reliability of the motion vectors in detecting 
25 regions by the motion vector value or the correlation value or their combination. 

An image motion vector detecting device of the present invention comprises; means for determining a correlation 
values in a specific deviation of each detecting region of plural detecting regions disposed in a screen, 

means for determining a motion vector in each detecting region from the correlation values, and 
30 weighting processing means for determining a motion vector of an entire screen from the motion vectors and weight 

coefficients set in each detecting region . 

An image motion vector detecting device of the present invention comprises; 

35 means for determining a correlation value in a specific deviation in each detecting region of plural detecting regions 

disposed in a screen, 

means for determining a motion vector in each detecting region from the correlation values, 
reliability judging means forjudging a reliability of the motion vector of detecting regions by the motion vector value 
or the correlation value or their combination, and 
40 weighting processing means tor determining a motion vector of an entire screen from weight coefficients set in 

each detecting region and the motion vector of the detecting region Judged to be reliable by the reliability judging 
means . 
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An image motion vector detecting device of the present invention comprises; 



means for determining a correlation value in a specific deviation in each detecting region of plural detecting regions 
disposed in a screen, 

means for determining a motion vector in each detecting region by the correlation values, 

classifying means for classifying the motion vectors into groups on the basis of a magnitude or direction or their 
50 differential value, 

camera shake group judging means for selecting a group for determining a motion vector of an entire screen from 
groups classified by the classifying means, and 

means for determining a motion vector of the entire screen from the motion vector of the group selected by the 
camera shake group judging means. 



An image motion vector detecting device of the present invention comprises; 

means for determining a correlation value in a specific deviation in each detecting region of disposed plural de- 
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tecting regions in a screen, 

means for determining a motion vector in each detecting region from the correlation values, 

reliability judging means for judging a reliability of a motion vector of the detecting region by the motion vector 

value or the correlation value or their combination, 

classifying means for classifying the motion vectors of the detecting regions judged to be reliable by the reliability 
judging means into groups on the basis of a magnitude, direction or their differential value, 
camera shake group judging means for selecting a group for determining a motion vector of an entire screen from 
a group classified by the classifying means, and 

means for determining a motion vector of the entire screen from the motion vector of the group selected by the 
camera shake group judging means. 

An image swing correcting device of the present invention comprises; 

image signal memory means or CCD for at least one field, 

said above-mentioned image motion vector detecting device , and 

reading position of the image signal memory means or CCD being controlled on the basis of a motion vector 
detected by the image motion vector detecting device. 

The invention, having the constitution as described herein, judges the reliability of the vector .in each detecting 
means by using not only the state of the correlation value in each detecting region, but also the time-course variation 
of the correlation value, Therefore, if the absolute value of the correlation value at a certain time is fluctuated by the 
noise and the reliability cannot be judged correctly, the judgment may be compensated by paying attention to the time- 
course variations. 

In each detecting region, moreover, by determining an intermediate judgment result from true to false from each 
one of plural sets of reliability judgment information, and obtaining one judgment value from plural intermediate reliability 
judgment results, the final judgment value of each detecting region is extracted. Thus by judging intermediately from 
true to false, the ambiguity of the threshold level of the judging condition is expressed, and a correct judgment is 
attained if any one of plural judgment regions is ambiguous. 

Besides, by determining the correlation of motion vectors of detecting regions, and varying the judging condition 
of the reliability depending on the value of the correlation of the motion vectors of the detecting regions, the reliability 
may be judged flexibly depending on the circumstances. 

In addition, by judging whether a moving object has invaded the region in each detecting region on the basis of 
the correlation value and the time-course variations of the correlation value, and by finding the correlation value between 
regions or the difference in time-course variations of the correlation value, the moving object is detected, and the motion 
vector of the entire screen is determined. Furthermore, on the basis of the determined motion vector of the entire 
screen, by controlling reading position of the image signal memory means or CCD, swing of the screen is corrected. 

Incidentally, when the presence of motion vector standing still in the motion vector in each detecting region is 
judged by the still judging means, since that motion vector expresses the still background, regardless of the result of 
the reliability judgment, the motion vector of the entire screen is determined by using this still vector. 

As a result of judgment of reliability, if the reliability is negatively judged at least in one detecting region, the motion 
vector of a relatively small value judged by the minimum judging means is regarded as the still background, and it is 
taken as the motion vector of the entire screen, by priority to the judgment result of reliability. 

If the similarity is judged to be present in the motion vector of each detecting region by the similarity judging means, 
it means that the entire screen is swinging in the same direction, and the screen drift should be corrected, and when 
there is no similarity, it is highly possible that an obstacle is present in the screen, and the detecting region having the 
obstacle should not be used in correction operation. 

A weight coefficient is set in each detecting region. In particular, the center of the screen denotes the motion of 
the subject, and it is expected that the motion of the camera shake is dominant at the end portion of the screen. Hence, 
the weight coefficient is increased at the end portion of the screen. On the basis of this weight coefficient, when the 
weighted mean of the motion vectors is calculated, a motion vector similar to the camera shake vector may be obtained 
by a simple calculation. 

Furthermore, in the detecting region judged to be free from reliability by the reliability judging means shows the 
motion vector of the subject, and when the weighted mean is calculated by using only the motion vectors in the detecting 
regions judged to be reliable, the correction performance of camera shake is further enhanced. 

As mentioned in relation to the problems that the invention is to solve, in the detecting region judged to be reliable 
by the reliability judging means, the motion of the camera shake and the motion of the subject coexist. Furthermore, 
the motion of the subject may not be always uniform. Accordingly, on the basis of the direction or magnitude, the motion 
vector in each detecting region is classified (clustered) into plural groups. When one of the groups is used as the motion 
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vector of the camera shake, it is expected similarly that the motion vector approximating the camera shake vector may 
be extracted. 

Furthermore, in the detecting region judged to be not reliable by the reliability judging means, since the motion 
vector of the subject is appearing, the correction performance of the camera shake may be further enhanced by clus- 
tering into groups by using only the motion vector in the detecting region judged to be reliable. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of a swing correction device applying a conventional image motion vector detecting device. 
Figs. 2, 5, 7 , 8, 9 are views for explaining operation of the conventional swing correction . 
Fig. 3 is a detailed structural diagram of reliability judging means in the conventional art. 
Fig. 4 is a flow chart for explaining the operation of the conventional motion vector detecting device. 
Fig. 6 is a diagram for explaining the ambiguity in a specific condition in the conventional art. 
Fig. 1 0 is a diagram for explaining the operation of the reliability judgment of a conventional motion vector detectinq 
is device. w 

Fig. 1 1 is a block diagram of an image motion vector detecting device in a first embodiment of the present invention. 
Fig. 12, Fig. 13 are diagrams for explaining the operation of the motion vector detecting device of the first embod- 
iment. 

Fig. 14 is a block diagram of a swing correcting device in a second embodiment of the present invention. 
Fig. 15 is a block diagram of a motion vector detecting device in a third embodiment of the present invention. 
Fig. 16, Fig. 17, Fig. 1B are diagrams showing the function of judgment values. 
Fig. 19 is a diagrams showing a contour line of judgment values. 
Fig. 20 is a diagrams showing results of conversion of judgment values. 

Fig. 21 is a block diagram of a swing correcting device in a fourth embodiment of the present invention. 
Fig. 22 is a block diagram of an image motion vector detecting device in a fifth embodiment of the present invention. 
Fig. 23 is a detailed structural diagram of reliability judging means and judgment converting means in the fifth 
embodiment the present invention. 

Fig. 24 is a diagram for explaining the operation of the reliability judging means in the fifth embodiment of the 
present invention. 

Fig. 25 is a block diagram of a swing correcting device in a sixth embodiment of the present invention. 
Fig. 26 is a block diagram of an image motion vector detecting device in a seventh embodiment of the present 
inventbn. 

Fig. 27 is a block diagram of a swing correcting device in an eighth embodiment of the present invention. 
Fig. 28 is a block diagram of an image motion vector detecting device in a ninth embodiment of the present invention. 
Fig. 29 is a detailed structural diagram of motion vector determining means in the ninth embodiment of the present 
invention. 

Fig. 30 is a detailed structural diagram of vector weighting means 17 in the ninth embodiment of the present 
inventbn. 

Fig. 31 is a block diagram of a sing correcting device in a tenth embodiment of the present invention. 
Fig 32 is a block diagram of an image motion vector detecting device in an eleventh embodiment of the present 
invention. 

Fig. 33 is a block diagram of a swing correcting device in a twelfth embodiment of the present invention. 
Fig. 34 is a block diagram of an image motion vector detecting device in a thirteenth embodiment of the present 
invention. 

Fig. 35 is a block diagram of a swing correcting device in a fourteenth embodiment of the present invention. 
Fig. 36 is a block diagram of an image motion vector detecting device in a fifteenth embodiment of the present 
inventbn. 

Fig. 37 is a diagram for explaining a changing method of judging condition. 

Fig. 38 is a block diagram of a swing correcting device in a sixteenth embodiment of the present invention. 
Fig. 39 is a block diagram of an image motbn vector detecting device in a seventeenth embodiment of the present 
inventbn. 

Fig. 40 is a block diagram of a swing correcting device in an eighteenth embodiment of the present invention. 
Fig. 41 is a block diagram of an image motion vector detecting device in a nineteenth embodiment of the present 
inventbn. 

Fig. 42 is a bbck diagram of a swing correcting device in a twentieth embodiment of the present invention. 
Fig, 43 is a block diagram of an image motion vector detecting device in a twenty-first embodiment of the present 
inventbn. 

Fig. 44 is a bbck diagram of a swing correcting device in a twenty-second embodiment of the present invention. 
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Fig. 45 is a block diagram of an image motion vector detecting device in a twenty-third embodiment of the present 
invention. 

Fig. 46 is a block diagram of a swing correcting device in a twenty-fourth embodiment of the present invention. 
Fig. 47 is a block diagram of an image motion vector detecting device in a twenty-fifth embodiment of the present 
invention. 

Fig. 48 is a diagram for explaining the operation of the motion vector detecting device in the twenty-fifth embodiment 
of the present invention. 

Fig. 49 is a block diagram of an image motion vector detecting device in a twenty-sixth embodiment of the present 
invention. 

Fig. 50 is a block diagram of an image motion vector detecting device in a twenty-seventh embodiment of the 
present invention. 

Fig. 51 is a diagram for explaining the operation of the motion vector detecting device in the twenty-seventh em- 
bodiment of the present invention. 

Fig. 52 is a block diagram of an image motion vector delecting device in a twenty-eighth embodiment of the present 
invention. 

Fig. 53 is a block diagram of a swing correcting device in a twenty-ninth embodiment of the present invention. 
Fig. 54 is a block diagram of an image motion vector detecting device in a thirtieth embodiment of the present 
invention. 

Fig. 55 is a diagram showing an example of detecting region of a motion vector. 

Fig. 56 is,a diagram for explaining the operation of the motion vector detecting device in the thirtieth embodiment 
of the present invention. 

Fig. 57 is a diagram showing an example of a detecting region of a motion vector. 

Fig. 58 is a block diagram of an image motion vector detecting device in a thirty-first embodiment of the present 
invention. 

Fig. 59 is a block diagram of an image motion vector detecting device in a thirty-second embodiment of the present 
invention. 

Fig. 60 is a block diagram of an image motion vector detecting device in a thirty-third embodiment of the present 
invention. 

Fig. 61 is a block diagram of an image motion vector detecting device in a thirty-fourth embodiment of the present 
invention. 

Fig. 62 is a block diagram of an image motion vector detecting device in a thirty-fifth embodiment of the present 
invention. 

Fig. 63 is a flow chart of an image motion vector detecting device. 

Fig. 64 is a diagram showing the operation and configuration of detecting regions in the screen of the motion vector 
detecting device in the thirty-fifth, thirty-sixth and thirty-seventh embodiment of the present invention. 
Fig. 65 is a diagram for explaining the operation of motion vector. 

Fig. 66 is a diagram for showing the relation between the content of the screen and the mean value. 
Fig. 67 is a block diagram showing the operation of the motion vector detecting device in the thirty-sixth embodiment 
of the present invention. 

Fig. 68 is a flow chart of an image motion vector detecting device. 

Fig. 69 is a block diagram showing the operation of the motion vector detecting device of the thirty-seventh em- 
bodiment of the present invention. 

Fig. 70 is a flow chart of the image motion vector detecting device. 

Fig. 71 is a diagram for explaining the operation of similarity and motion vector. 

Fig. 72 is a diagrams showing the operation of motion vector and similarity. 

Fig. 73 is a block diagram showing the operation of a motion vector detecting device in a thirty-eighth embodiment 
of the present invention. 

Fig. 74 is a diagram showing a detecting region in a screen. 

Fig. 75 is a diagram showing a moving object (an automobile) invading into the detecting region in Fig. 74. 
Fig. 76 is a block diagram showing the operation of a motion vector detecting device in a thirty-ninth embodiment 
of the present invention. 

Fig. 77 (a) is a diagram of invasion of the moving object (automobile) into the detecting region, (b) is a diagram 
showing the detecting region judged to be not reliable by the reliability judging means. 

Fig. 78 is a block diagram showing the operation of a motion vector detecting means in a fortieth embodiment of 
the present invention. 

Fig. 79 (a) is a diagram of invasion of a moving object (a man) invading in the detecting region, (b) is a diagram 
of clustering of motion vectors in each detecting region. 

Fig. 80 is a diagram showing the clustered detecting regions. 
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Fig. 81 is a block diagram showing the operation of a motion vector detecting device in a forth -first embodiment 
of the resent invention. 

Fig. 82 (a) is a diagram of a moving object (a man) invading in the detecting region, (b) is a diagram showing 
clustered detecting regions. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS OF THE INVENTION 

Fig. 11 is a block diagram of a motion vector detecting device in a first embodiment of the present invention, in 
which numeral 1 is an image signal input terminal, 2 is a vector detecting circuit of each detecting region, 3 is a corre- 

10 lation value detecting part, 4 is a time-course variation detecting part of correlation value, 5 is reliability judging means 
of vector, and 6 is motion vector detecting means. 

In thus composed image motion vector detecting device in the first embodiment, first of all, an image signal con- 
tinuous in time for at least two fields is entered in the input terminal 1 . In the vector detecting circuit 2 of each detecting 
region, preliminarily, as shown in 209, 210, 211, 212 in Fig. 74, four vector detecting regions are determined in the 

15 screen, and concerning the detecting regions between two fields, the difference of position signals deviated by the 
quantity in specified range(i,j) :imin < i < imax , jmin < j < jmax ,that is, is determined as the correlation value £ I A L I 
(ij) ,and the deviationfi'J 1 ) for giving the minimum value of that value is detected, and it is obtained as the motion vector 
of each region. In the correlation value detecting part 3, the minimum, mean and maximum of the correlation values 
are obtained. In the time-course variation detecting part 4 of the correlation values.the time differential value after 

20 averaging the. correlation values. or the difference value is determined. The reliability judging circuit means 5 of vectors 
judges the reliability in each region from the correlation value entered from the correlation value detecting part 3 and 
the time-course variation value of the correlation values entered from the time-course variation detecting part 4 of the 
correlation value, and delivers the result of judgment and the motion vector of each region to the motion vector deter- 
mining means 6. The motion vector determining means 6 determines the intermediate value of the motion vector of 

25 each region judged to be reliable (the value positioned in the middle when arranged in the sequence of magnitude, in 
the case of the quantity in an even number, the mean of two values close to the middle position ) as the motion vector 
of the entire screen, and delivers. 

What is different from the conventional motion vector detecting device is that the reliability of the motion vector of 
each detecting region is judged not only by the state of the present correlation value in each detecting region, but also 

30 by the time-course variation value of the correlation value. This point is described in further detail. As shown in Fig. 2, 
when a moving object such as a person enters the vector detecting region, the time-course changes of the correlation 
value are shown in Fig. 12 and Fig. 13. In both Fig. 12 and Fig. 1 3, (a) is the minimum of the correlation value, and (b) 
denotes the time-course variation (differential value) of the minimum of the correlation value. At this time, as the judging 
level of the reliability, supposing the minimum to be level m, and the time-course change of the minimum to be level 

35 b, the reliability is negative if at least one of them is greater than the judgment level. Fig. 1 2 and Fig. 1 3 are photographs 
of almost the same scene, and the moving object has crossed before the camera in both, and the minimum is near 
the judgment level. In (a), the minimum is over the level m, and the invasion of the moving object detected and the 
reliability is negatively confirmed. On the other hand, in (b) the minimum is less than level m, and the invasion of the 
moving object cannot be detected by the minimum alone, but the differential value of the minimum is over level b, and 

40 therefore invasion of the moving object can be detected. 

Thus, according to the embodiment, when judging the reliability of the motion vector in each detecting region, it is 
possible to correctly judge the reliability by detecting not only the state of the present correlation values of the detecting 
regions, but also the time-course variations of the correlation values, even if one of them is fluctuated by noise or the 
like,. 

4£ A block diagram of a swing detecting device in a second embodiment of the present invention is shown in Fig. 1 4. 

The same parts as in Fig. 11 are identified with same reference numbers, and repeated explanation is omitted. In Fig. 
14, numeral 7 is swing correcting means. 

In thus composed second embodiment, the blocks of the image motion vector detecting device are same in oper- 
ation as the first embodiment. 

so The swing correcting means 7, when an image of a large fluctuation enters as shown in 226, 227 in Fig. 5, moves 

the image parallel from 229 to 229 in the direction 231 of correcting the motion, on the basis of the motion vector 230 
entered from the motion vector determining means 6, as to the input image signals of the (n-1 )-th field 226, and the n- 
th field 227, and expands the screen by interpolation or the like, and delivers image signals 232, 233 in a size of one 
screen small in swing. 

55 Thus, according to the embodiment, when judging the reliability of the motion vector of each detecting region, by 

using not only the state of the present correlation values in the detecting regions but also the time-course fluctuation 
values of correlation values, the reliability may be judged correctly even if one of the values is fluctuating due to noise 
or the like, and even if a moving object occupying the majority or whole of the screen passes through the screen , 
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malfunction to correct the screen in a different direction from the intended direction of the operator due to interruption 
of correction does not occur. Meanwhile, the number of detecting regions in the screen of the first and second embod- 
iments is four, but it is not limitative. 

A motion vector detecting device in a third embodiment of the present invention is described below. The configu- 

5 ration of the motion vector detecting device in the third embodiment is shown in Fig. 15. Those same as in Fig. 11 are 
identified with same reference numbers and are not explained. In Fig. 15, numeral 8 is a reliability judging information 
detecting part, 9-1 9-n are first judging means for determining the judgment value of ternary or higher value taking 
the values in interval [0, 1], 10 is second judging means for determining the judgment value of the ternary or higher 
value taking the values in the interval [0, 1] from the judgment values of plural ternary or higher values by the first 

10 judging means 9-1,9-2,...,9-n, and 11 is judgment value converting means for converting the judgment value by the 
second judging means 10 into a binary judgment value of {0, 1}. In this embodiment, as the result of the judgment 
having the meaning between true to false, value, the judgment value of ternary or higher value taking the value in the 
interval of [0, 1] is used, which is a characteristic point. 

In thus composed image motion vector detecting device of the third embodiment, the method of extracting the 

15 correlation value with the motion vector of each region is same as in the first embodiment and is omitted herein. The 
reliability judgment information detecting part 8 functions as the time-course variation detection part 4 of the correlation 
value and the correlation value detection part 3 in Fig. 13, and as the plural sets of information of reliability judgment , 
the minimum: mean .maximum of the correlation values , and the time differential value of the correlation values or the 
difference as the time-course variation of the correlation values, are obtained. In the first judging means 9-1 to 9-n, the 

20 reliability of -each region is judged by the ternary or higher value taking the values in the interval [0, 1], with respect to 
each information from the plural sets of information about the correlation value entered from the reliability judgment 
information detecting part 8. The second judging means 10 determines one judgment value taking the values in the 
interval [0, 1] in each region by averaging or multiplying the plural judgment values obtained by the first judging means 
9-1 to 9-n. The judgment value converting means 11 converts the judgment value taking the values in the interval [0, 

2S i] obtained by the second judging means 1 0 into a binary value of { 0, 1 } from a specific level boundary, and the result 
of the judgment is delivered to the motion vector determining means 6, together with the motion vector in each region. 
The motion vector determining means 6 delivers the intermediate value of the motion vectors from the regions judged 
to be reliable, as the motion vector of the screen. 

The deduction of the judgment result of each region different from the conventional motion vector detecting device 

30 is described in further detail below. First, the method of determining the ternary or higher judgment value taking the 
values in the interval [0, 1] by the first judging means 9-1 to 9-n is described. To determine the value of judgment of 
ternary or higher value taking the values in the interval [0, 1], the function of the judgment value is set as shown in Fig. 
16. In Fig. 1 6, the axis of abscissas denotes the value of correlation, and the axis of ordinates represents the judgment 
value from 0 to 1 corresponding to the correlation value. The function of the judgment value is not limited in the shape, 

35 and an example of other function is shown in Fig. 17. In Fig. 1 6, Fig. 17, the judgment values are the function to deliver 
continuous values from 0 to 1 , but a function delivering discrete value of ternary or higher value may be used as shown 
in Fig. 18. By using the function of such judgment value, in the first judging means 9-1 to 9-n , the judgment value of 
ternary or higher value taking the values in the interval [0, 1] is determined. Next, in the second judging means 10, 
from plural judgment values, the method of determining one judgment value having the value in the interval [0, 1] is 

40 explained below. Suppose, in the first judging means 9-1 to 9-n, the judgment values having n values in the interval 
[0, 1] from s1 to sn are obtained. To obtain one judgment value a from them, the following averaging calculation is 
employed. 

45 a=(s1+ — +sn)/n 

Or each judgment value is weighed with a1 to an, and one judgment value is determined in the weighted mean calcu- 
lation shown below. 

so 

a=(a1*s1+ — +an*sn)/(a1+ — +an) 
Or, as shown below, the product of n judgment values s1 to sn is supposed to be a. 

55 

a=s1* — *sn 

Fig. 19 shows the contour line of the judgment value a when two correlation values are used in the judgment. In 
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Fig. 19, the function of the judgment value is trapezoidal as shown in Fig. 16, and the mean calculation is employed 
for deducing a. 

Next is explained the method of converting finally to the binary judgment value of {0, 1} from the ternary or higher 
judgment value a taking the value in the interval [0, 1] determined in anyone of the above methods. The judgment 

5 value converting means 1 1 compares the ternary or higher judgment value having the value in the intervalJO, 1 ] obtained 
by the second judging means 10 with the specified converting level, and converts to the binary judgment value of {0, 
1}, specifically 1 when the judgment value is greater than the specified converting level, and 0 when smaller than the 
specified converting level. Fig. 10 shows the result of converting from the ternary or higher judgment value a having 
the value in the interval [0, 1] shown in Fig. 19, to the binary judgment value of {0, 1} at the converting level 0.5 . In the 

10 diagram, the shaded area denotes 1, and the other region is 0. 

Thus, in the method of deducing the judgment result in the embodiment, the ternary or higher judgment value 
having the value in the interval [0, 1 ] is obtained from each one of plural sets of reliability judgment information in each 
detecting region, and by determining one ternary or higher judgment value from plural ternary or higher judgment 
values, the binary judgment value of each detecting region is finally obtained. As a result, the ambiguity of the threshold 
level in the interval [0, 1] is expressed, and if one of the plural judgment results be ambiguous, correct judgment is 
obtained. 

This point is described in detail by referring to the data D1 , D2 in Fig. 6 mentioned in relation to the problems that 
the invention is to solve. The data D1 . D2 are obtained in the same conditions and are essentially identical, but in the 
prior art, it is an ambiguous judging region for condition 2, and only the binary judgment value of {0 : 1 } can be handled, 
20 and therefore D1 is judged to be reliable (judgment value =1), and D2 not reliable (= 0). In this embodiment, on the 
other hand, since the judgment value can be handled in the interval [0, 1], and the judgment values of D1 and D2 are, 
as shown in Fig. 1 9, obtained as mutually close judgment values as a (D1 ) = 0. 76, a (D2) = 0.68, and the final judgment 
result is both reliable as shown in Fig. 20. Thus, in this embodiment, even the data fluctuating due to noise may be 
judged correctly. 

2S in the embodiment, meanwhile, all judgment values are explained by standardizing in the interval [0, 1], but this 

is not limitative, and for example, it may be in the interval [0, 1 0] or [-50, 50], and it is the characteristic of this embodiment 
to employ the ternary or higher value, instead of the binary value, in the judgment value. 

A block diagram of a swing correcting device in a fourth embodiment of the present invention is described in Fig. 
21. Those same as in Fig. 14, Fig. 15 are identified with same reference numbers, and explanations are omitted. 

30 in thus composed fourth embodiment, the blocks of the image motion vector detecting device are same in operation 

as in the third embodiment, and is not explained herein. 

The swing correcting means 7, when receiving the image with large fluctuation as shown in 226, 227 in Fig. 5, 
moves the constitution of the image parallel from 229 to 228 in the direction 231 for correcting the motion, on the basis 
of the motion vector 230 entered from the motion vector determining means 6, with respect to the input image signal 

35 of the (n-1 )-th field 226, the n-th field 227, and enlarges or manipulates the constitution by interpolation or the like, and 
delivers the image signals 232, 233 in the size of one constitution small in swing. 

Thus, according to the embodiment, when judging the reliability of the motion vector in each detecting region, the 
ternary or higher judgment value in the interval [0, 1 ] is determined from each one of the plural sets of reliability judgment 
information in each detecting region, and by obtaining one ternary or higher judgment value from plural ternary or 

40 higher judgment values, the final binary judgment value in each detecting region is obtained. Consequently, even if 
one of the plural sets of judgment information is fluctuating due to noise or the like, the reliability can be judged correctly, 
and if a moving object occupying the majority or whole of the screen passes through the screen , malfunction of cor- 
recting in a wrong direction from the direction intended by the operator due to interruption of the correction is avoided. 
Meanwhile, in the third and fourth embodiments, the number of detecting regions in the screen may be four or other. 

45 The motion vector detecting device in a fifth embodiment of the present invention is described below. The config- 

uration of the motion vector detecting device of the fifth embodiment is shown in Fig. 22. Those same as in Fig. 15 are 
identified with same reference numbers, and explanations are omitted. In Fig. 22, numerals 1 3-1 , 1 3-n are judging 
means for judging the binary judgment value of {0, 1} in every divided judgment interval, and 14 is judgment value 
converting means for converting from the plural judgment results by the judging means into one binary judgment value 

so of {0, 1 }. In this embodiment, it is characteristic that the binary judgment value of {0, 1 } is used in every divided judging 
interval as the judgment result having the meaning between true and false values. 

In thus composed image motion vector detecting device of the fifth embodiment, the method of obtaining the motion 
vector of each region and the reliability judgment information is same as in the third embodiment and is not explained 
herein. In the judging means 1 3-1 to 13-n, the reliability of each region is judged for each information from the plural 

55 sets of information of the correlation value entered from the reliability judgment information detecting part 8. In each 
judgment interval divided with respect to each judgment information in every region, the binary judgment of {0, 1} is 
effected. The judgment value converting means 14 converts from the binary judgment value of {0, 1} in the plural 
judgment intervals obtained in each region into one binary judgment value of {0, 1}, and the result of judgment is 



11 



0 

* 



EP 0 458 249 B1 



delivered to the motion vector judging means 6 together with the motion vector in each region. The motion vector 
judging means 6 delivers the intermediate value of the motion vector from the region judged to be reliable, as the 
motion vector of the screen. 

The method of deduction of the judgment result in each region different from the motion vector detecting device 

s in the third embodiment is further described below. For the sake of simplicity of explanation, the number of pieces of 
reliability judgment information is two, but this s not limitative. Fig. 23 shows the detailed configuration of the judging 
means 13 and judgment value converting means 14. In Fig. 23, numerals 13-1 (a) to 13-1(d), and 13-2(a) to 13-2(d) 
are judging circuits for delivering the binary judgment value of {0, 1} in every judging interval, and the judgment value 
converting circuit 14 is composed of AND and OR circuits. The output signals of the judging circuits 1 3-1 (a) to 13-1 (d) 

to are shown in Fig. 24 (a) to (d), and it is same in 1 3-2(a) to 13-2(d). That is, 13-1 (a) is 1 when the judgment information 
1 is from p to q, 13-1(b) is when q to r, 13-1(c) is when r to s, and 13-1(d) is when higher than s, and otherwise 0. It is 
false when all of 13-1 (a) to 13-1(d) are 0, and true when 13- 1(d) is 1, and intermediate in the meaning from true to 
false when any one of 13-1 (a), (b), (c) is 1, which shows the result of judgment. In this case, in order to have the 
meaning between true and false by using a binary value of 0 or 1 , the judgment region is divided into five intervals as 

15 less than p, p to q, q to r, r to s, and more than s as shown in Fig. 24. as for the ambiguous judgment interval W1 shown 
in Fig. 6. It means the same effect as using the five discrete values for judgment from 0 to 1 . by the function of the 
judgment values for the whole region of judgment as shown in Fig. 18 in the third embodiment. In other words, 13-1 
(a), 13-2(a) corresponds to 0.25, 13-1(b), 13-2(b) to 0.5, 13-1(c), 13-2(c) to 0.75, and 13-1(d), 13-2(d) to 1, thus cor- 
responding to the intermediate judgment values from 0 to 1. Suppose 13-1(b) to be 1 from the judgment information 

20 i. At this time, the final judgment result of the judgment value converting means 14 becomes 1 when the judgment 
result by the judgment information 2 is 1 in 13-2(c) or 1 in 13-2(d). In other words, seeing that 13-1(b) corresponds to 
0.5, 1 3-2(c) to 0.75, 1 3-2(d) to 1 , it means that the final judgment result is 1 when the mean of the intermediate judgment 
value from 0 to 1 by two sets ol judgment information is greater than 0.5. This is the same result as shown in the third 
embodiment. 

25 Thus, the method of obtaining the judgment result in the embodiment is to determine the binary value of {0, 1 ) in 

every divided judgment interval corresponding to every one of plurality of reliability judgment information in every de- 
tecting region, and to obtain one binary judgment value of {0 or 1 }] from the binary judgment values of {0, 1} of plural 
judgment intervals, thereby leading out the final binary judgment value in each detecting region. Accordingly, expressing 
the ambiguity of the threshold level in the judgment of binary value of {0, 1} in every divided judgment interval, and if 

30 one of the plural judgment results be ambiguous, correct judgment is achieved. As far as the function is the same as 
mentioned in this embodiment, other method may be also employed. 

Fig. 25 is a block diagram of a swing correcting device in a sixth embodiment of the present invention. Those same 
as shown in Fig. 14. Fig. 22 are identified with same reference numbers, and explanations are omitted. 

In thus composed sixth embodiment, the blocks of the image motion vector detecting device is same in operation 

35 as the fifth embodiment, and its explanation is omitted. As for the operation of the swing correcting means, it is same 
as explained in the second and fourth embodiments, and the repeated explanation is omitted. In the fifth and sixth 
embodiments, the number of detecting regions on the screen may be either four or other. 

The motion vector detecting device of the seventh embodiment of the present invention is described. The config- 
uration of the motion vector detecting device of the seventh embodiment is shown in Fig. 26 Those same in Fig. 15 

40 are identified with same reference numbers, and are omitted in explanation. In Fig. 26, numeral 15 is a motion vector 
determining means. 

In thus composed image motion vector detecting device of the seventh embodiment, the process up to determining 
one judgment valued a having the value in the interval [0, 1] in each region is same as in the third embodiment, and 
the explanation is omitted. What is different from the motion vector detecting device in the third embodiment is the 

45 method of determining the motion vector of the screen, and this point is described in detail below. 

In the vector detecting circuit 2 in each detecting region, preliminarily, as shown by 209, 210, 211, 212 in Fig. 2, 
four vector detecting regions are determined in the screen, and in each detecting region between two fields, the dif- 
ference X I A L I (i,j) of the signal at the position deviated by the quantity (i,j):imin < i < imax, jmin < j < jmax in a specified 
range is respectively obtained as the correlation value, and the deviation (i\ j') for giving the minimum of the value is 

so detected, and it is taken as the vector Vi (i = 1 to 4) in each region. On the other hand, in the second judging means 
10, from the plural judgment values obtained by the first judging means 9, one judgment value a i (i = 1 to 4) having 
the value in the interval [0, 1] is obtained in each region. In the motion vector determining means 15, from the judgment 
value ai having the value in the interval [0,1] and that vector Vi in each region, the motion vector V of the screen is 
determined by the following equation. 

55 

V- a1*V1+a2*V2+a3*V3+a4*V4 
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Thus, in the motion vector detecting device of the embodiment, in each detecting region, from the plural sets of 
reliability judgment information in each detecting region, the ternary or higher judgment value having the value in the 
interval [0, 1 ] is obtained, and one ternary or higher judgment value is obtained from the plural te rnary or higher judgment 
values. From the ternary or higher judgment value and the vector in each detecting region, the motion vector of the 
screen is finally determined. As a result, by the judgment value having the value in the interval [0, 1] in each region, 
the ambiguity of the result of judgment is expressed, and the motion vector may be determined by reducing the weight 
in the ambiguous region of the result of judgment. In this embodiment, meanwhile, plural judgment values from the 
first judging means 9-1 to 9-n2 are converted into one judgment value by the second judging means 1 0, but the second 
judging means 10 may not be required, and the plural judgment values by the first judging means 9-1 to 9-n may be 
directly used as weight coefficients to determine the motion vector. The information used in judgment of reliability of 
each region may be only one, and the first judging means 9-1 to 9-n may be also only one. 

Fig. 27 shows a block diagram of a swing correcting device in an eighth embodiment of the present invention. 
Those same in Fig. 14, Fig. 26 are identified with same reference numbers, and the explanation is omitted. 

The swing correcting means 7, when receiving an image of large fluctuation as indicated by 226, 227 in Fig. 5, 
moves the screen of the image parallel from 229 to 228 in the direction 231 of correcting the motion, on the basis of 
the motion vector 230 entered from the motion vector determining means 15, with respect to the input image signals 
of the (n-1)-th field 226 and the n-th field 227, and enlarges or manipulates the screen by interpolation or the like, 
thereby delivering image signals 232, 233 in a size of one screen less in fluctuation. 

Thus, in, this embodiment, when judging the reliability of the vector in each detecting region, the ternary or higher 
judgment value having the value in the interval [0, 1 ] is determined from each one of the plural sets of reliability judgment 
information in each detecting region, and one ternary or higher judgment value is determined from plural ternary or 
higher judgment values. Furthermore, from this ternary or higher judgment value and the vector in each detecting 
region, the motion vector of the screen is finally determined. As a result, even when one of the plural sets of judgment 
information is fluctuated due to noise or the like, the motion vector of the screen may be correctly determined, and if 
a large object occupying the majority or whole of the screen crosses the screen, malfunction due to correction of the 
screen in a a wrong direction from the intended direction of the operator due to interruption of the correction may be 
avoided. In the embodiment in Figs. 17, 18, meanwhile, the number of detecting regions in the screen is four, but this 
is not limitative. 

The motion vector detecting device of the ninth embodiment of the present invention is explained below. The 
configuration of the motion vector detecting device of the ninth embodiment is shown in Fig. 28. Those same in Fig. 
22 are identified with same reference numbers, and the explanation is omitted. In Fig. 28, numeral 16 is motion vector 
determining means. 

In each detecting region of the image motion vector detecting device of thus composed ninth embodiment, the 
process up to determining the binary judgment value of {0, 1} in each judgment interval divided with respect to each 
one of the plural reliability judgment information sets is same as in the fifth embodiment, and the explanation is omitted. 
What is different from the motion vector detecting device in the fifth embodiment is the method of determining the 
motion vector of the screen which is described in detail below. 

In the vector detecting circuit 2 of each detecting region, preliminarily, as indicated by 209, 210, 211, 212 in Fig. 
2, four vector detecting regions are determined in the screen, and in each detecting region between two fields, the 
difference II A L I (i,j) of the signal of the position deviated by the quantity (ij).imin < i< imax, jmin < j < jmax in a 
specified range is determined as the correlation value : and the deviation (i'.f) for giving the minimum value of this value 
is detected, and it is obtained as the vector Vi (i = 1 to 4) in each region. 

In the motion vector determining means 16, the motion vector V of the screen is determined from the vector Vi of 
each region and the binary judgment value of {0, 1} in each divided judgment interval. Fig. 29 shows a detailed con- 
stitution of the motion vector determining means 16. The motion vector determining means 16 comprises weighting 
means 1 7-1 to 1 7-8 of the vectors in each region and an adder. A detailed configuration of the vector weighting means 
17 is shown in Fig. 30. The vector weighting means 17 consists of attenuator 18 and switching element. The weighting 
means 1 7 receives, besides the vector Vi in each region, the binary judgment value of{0, 1 J in each judgment divided 
interval from the judging means 13, and the switching element receiving the judgment value of 1 is turned on. In 
consequence, the damping factor of the attenuator connected to the switching element which is turned on is multiplied 
by the vector V, and the product is delivered from the weighting means 17. The vector Vi in each region is multiplied 
by the damping factor in the above method by the two weighting means as shown in Fig. 29 : and added up in the adder. 
The output after addition becomes the vector Vi weighted by the sum of the damping factors multiplied by the two 
weighting means. Here, the weight of the vector Vi after addition corresponds to the weight coefficient cti in the seventh 
embodiment, and in this embodiment, too, the sum of the damping factors is expressed as ai. The vector Vi weighted 
with ai in each detecting region is summed up in four regions by the adder, and the final motion vector V of the screen 
is obtained. This is expressed in the following formula. 
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V= a1*V1+a2*V2+a3*V3+a4*V4 

This equation is exactly same as the formula of determining the vector V in the seventh embodiment. 

Thus, in the motion vector detecting device of the embodiment, the binary judgment value of {0, t } is determined 
in each judgment interval divided corresponding to each one of plural sets of reliability judgment information in each 
detecting region, and the weight coefficient of the vector in each detecting region is determined by the damping factor 
corresponding to the interval in which the judgment is 1 . From this weight factor and the vector in each detecting region, 
the motion vector of the screen is finally determined. As a result, the ambiguity of the threshold level is expressed by 
the binary judgment of 0, 1 in each divided judgment interval, and the motion vector may be determined by reducing 
the weight in the region with ambiguous result of judgment. 

Fig. 31 is a block diagram of a swing correcting device in a tenth embodiment of the present invention. Those 
same as in Fig. 14, Fig. 28 are identified with same reference numbers and are not explained herein. 

The blocks of the image motion vector detecting device of thus composed tenth embodiment are same in operation 
as the ninth embodiment, and its explanation is omitted. 

A swing correcting means 7, when receiving an image with large fluctuation as indicated by 226, 227 in Fig. 5, 
moves the screen of the image parallel from 229 to 228 in a direction 231 of correcting the motion on the basis of the 
motion vector 230 entered from the motion vector determining means 16, with respect to input image signals in the (n- 
1)-th field 226, the n-field 227, and enlarges or manipulates the screen hy interpolation or the like, thereby delivering 
image signals 232, 233 in a size of one screen small in fluctuation. 

Thus, in this embodiment, in each detecting region, the binary judgment value of {1 , 2} is obtained in each judgment 
interval divided with respect to each one of plural sets of reliability judgment information, and the weight coefficient of 
the vector in each detecting region is determined by the damping factor corresponding to the interval in which the 
judgment is 1. From this weight coefficient and the vector in each detecting region, the motion vector of the screen is 
finally determined. As a result, by the binary judgment of {0, 1} in each divided judgment interval, the ambiguity of the 
threshold level is expressed, and the motion vector may be determined by reducing the weight in the region with 
ambiguous result of judgment and , even if a large object occupying the majority or whole of the screen passes the 
screen, the malfunction of correction of the screen in wrong direction from the direction intended by the operator due 
to interruption of the correction is avoided. Meanwhile, in the ninth and tenth embodiments, the number of detecting 
regions in the screen is four, but it may be also a different number. 

The motion vector detecting device in an eleventh embodiment of the present invention is described below. The 
configuration of the motion vector detecting device of the eleventh embodiment is shown in Fig. 32. This embodiment 
is based on the conventional motion vector detecting device, and those same as in the prior art in Fig. 1 are identified 
with same reference numbers, and explanations are omitted. What is different from the prior art is that the motion 
vector correlation value calculating means 1 9 and judgment condition varying means 20 are provided as shown in Fig 
32. 

In thus composed image motion vector detecting device of the eleventh embodiment, preliminarily as indicated by 
209, 210, 211 , 222 in Fig. 2, four vector detecting regions are determined in the screen, and the vector Vi (i = 1 to 4) 
of each region is determined in the vector detecting circuit 2. In the correlation value calculating means 19 of motion 
vectors, the correlation value C between motion vectors in the detecting regions is determined in the following equation. 

4 4 

C = £ E I Vi- v j I 

In the judgment condition varying means 20, when the correlation value C of the motion vector is less than the 
specified value, the value of the threshold level Ref of the judgment condition in the comparator 220 shown in Fig. 3 
is changed into the direction of making the judgment condition less severe. Besides, it may be also considered to 
change the comparators by the correlation value C by preparing plural comparators differing in the threshold level of 
the judgment condition. Meanwhile, the number of changes of the judgment condition by the correlation value is not 
limited to two. 

In the embodiment, incidentally, if the motion vectors in the detecting regions are correlated, the judgment condition 
of the reliability is made less severe. That is, the correlation between motion vectors in the detecting region , means 
that the entire screen is moving in a same direction, and it is less possible that it is due to the motion of the subject or 
the like, and it may be all right if the judgment condition is made less severe. 

Fig. 33 is a block diagram of a swing correcting device in a twelfth embodiment of the present invention. Those 
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same in Fig. 14 and Fig. 32 are identified with same reference numbers, and explanations are omitted. 

In thus composed twelfth embodiment, the block of the image motion vector detecting device is same in operation 
as the eleventh embodiment, and its explanation is omitted. The operation of the swing correcting means is also same 
as in the second and fourth embodiments, and the explanation is omitted. In the eleventh and twelfth embodiments, 
the number of detecting regions in the screen is four, but this is not limitative. 

The motion vector detecting device of the thirteenth embodiment of the present invention is explained below. The 
configuration of the motion vector detecting device of the thirteenth embodiment is shown in Fig. 34. This embodiment 
is based on the motion vector detecting device in the first embodiment, and those same as in the configuration of the 
first embodiment in Fig. 11 are identified with the same reference numbers, and the explanations are omitted. What is 
different from the first embodiment is that the motion vector correlation value calculating means 19 and the judgment 
condition varying means 20 are disposed as shown in Fig. 34. 

In thus composed image motion detecting device of the thirteenth embodiment, the operation of the motion vector 
correlation calculating means 19 and the judgment condition varying means is same as explained in the eleventh 
embodiment of Fig. 32. 

Next, a block diagram of a swing correcting device in a fourteenth embodiment of the present invention is shown 
in Fig. 35. Those same as in Fig. 14, Fig. 34 are identified with same reference numbers and explanation are omitted. 

In thus composed fourteenth embodiment, the block of the image motion vector detecting device is same in oper- 
ation as the thirteenth embodiment, and its explanation is omitted. The operation of the swing correcting means is also 
same as explained in the fourth embodiment v and the explanation is omitted. In the thirteenth and fourteenth embod- 
iments, the number of detecting regions in screen is four, but this is not limitative. 

Next, the motion vector detecting device in a fifteenth embodiment of the present invention is explained. The 
configuration of the motion vector detecting device of the fifteenth embodiment is shown in Fig. 36. This embodiment 
is based on the motion vector detecting device of the third embodiment, and those same as in the configuration of the 
third embodiment in Fig. 15 are identified with the same reference numbers and are not explained herein. What is 
different from the third embodiment is that the motion vector correlation calculating means 1 9 and judgment condition 
varying means 20 are disposed as shown in Fig. 36. 

In thus composed image motion vector detecting device of the fifteenth embodiment, the operation of the motion 
vector correlation calculating means 19 is same as explained in the eleventh embodiment. The judgment condition 
varying means 20 changes the function of the judgment value as shown in Fig. 37 so that the judgment condition may 
be made less severe when the correlation value C of the motion vector is less than the specified value. In Fig. 37, the 
function of the judgment value is moved parallel, but this is not limitative, and the shape of the function may be varied. 
Or, it may be also considered to prepare two judging means different in the function of the judgment value and to 
change the judging means depending on the correlation value C. Meanwhile, the number of changes of judgment 
condition by the correlation value is not limited to two. 

Fig. 38 is a block diagram of a swing correcting device in a sixteenth embodiment of the present invention. Those 
same as in Fig. 14, Fig. 36 are identified with the same reference numbers, and explanations are omitted. 

In thus composed sixteenth embodiment, the block of the image motion vector detecting device is same in action 
as the fifteenth embodiment, and its explanation is omitted. The operation of the swing correcting means is same as 
explained in the second and fourth embodiments, and its explanation is omitted. In the fifteenth and sixteenth embod- 
iments, the number of detecting regions in the screen is four, but it may be also other number. 

Next, the motion vector detecting device of the seventeenth embodiment of the present invention is described 
below. The configuration of the motion vector detecting device of the seventeenth embodiment is shown in Fig. 39. 
This embodiment is based on the motion vector detecting device of the third embodiment, and those same as in the 
configuration of the third embodiment in Fig. 1 5 are identified with same reference numbers and the explanations are 
omitted. What is different from the third embodiment is that the motion vector correlation value calculating means 19 
and judgment condition varying means 20 are disposed as shown in Fig. 39. 

In thus composed image motion vector detecting means of the seventeenth embodiment, the operation of the 
motion vector correlation value calculating means 1 9 is same as explained in the eleventh embodiment The judgment 
condition varying means 20 changes the conversion level of the judgment value varying means 11 for comparing the 
specified conversion level with the ternary or higher judgment value having the value in interval [0, 1] obtained by the 
second judging means 10 , so that the judgment condition may be made less severe when the correlation value C of 
the motion vector is less than the specified value. Or it may be also possible to prepare plural judgment value converting 
means differing in the conversion level, and change over the judgment value converting means depending on the 
correlation value C. The number of changes of the judgment conditions by the correlation value is not limited to two 
alone. 

Fig. 40 is a block diagram of a swing correction device in an eighteenth embodiment of the invention. Those same 
as in Fig. 14, Fig. 30 are identified with same reference numbers, and are not explained herein. 

In thus composed image motion vector detecting device of the eighteenth embodiment, the operation is same as 



15 



EP 0 458 249 B1 

in the seventeenth embodiment, and its explanation is omitted. The operation of the swing correcting means is also 
same as explained in the second and fourth embodiments, and its explanation is omitted. In the seventeenth and 
eighteenth embodiments, the number of detecting regions in the screen may be either four or other. 

Next, the motion vector detecting device of a nineteenth embodiment of the invention is explained. The configu- 
5 ration of the motion vector detecting device of the nineteenth embodiment is shown in Fig. 41. This embodiment is 
based on the motion vector detecting device of the fifth embodiment, and the parts same as in the configuration of the 
fifth embodiment in Fig. 22 are identified with same reference numbers, and their explanation is omitted. What is 
different from the fifth embodiment is that the correlation value calculating means 19 of motion vector and judgment 
condition varying means 20 are disposed as shown in Fig. 41 . 

10 in the image motion vector detecting device of thus composed nineteenth embodiment, the operation of the cor- 

relation value calculating means 1 9 of motion vector is same as explained in the eleventh embodiment. The judgment 
condition varying means 20 changes to make the judgment condition of the judging means 13 less severe when the 
correlation vector C of the motion vector is less than s specific value. That is, the judgment intervals from p to s shown 
in Fig. 24 are moved to the less severe direction of the judging condition. It may be also possible to prepare plural 

15 judging means differing in the judging intervals, and change over the judging means depending on the correlation value 
C. The number of changes of judging condition by the correlation value is not limited to two. 

Fig. 42 is a block diagram of a swing correcting device in a twentieth embodiment of the invention. Those same 
as in Fig. 14, Fig. 41 are identified with same reference numbers, and the explanation is omitted. 

The blocks of the image motion vector detecting device of thus composed twentieth embodiment are same in 

20 operation as the nineteenth embodiment, and its explanation is omitted. The operation of the swing correcting means 
is also same as in the second and fourth embodiments, and the explanation is omitted. In the nineteenth and twentieth 
embodiments, the number of detecting regions in the screen may be either four or other. 

Next the motion vector detecting device in a twenty-first embodiment of the invention is described below. The 
configuration of the motion vector detecting device of the twenty-first embodiment is shown in Fig. 43. This embodiment 

25 js based on the motion vector detecting device of the seventh embodiment of the invention, and those same as in the 
configuration of the seventh embodiment in Fig. 26 are identified with same reference numbers, and are not explained 
herein. What is different from the seventh embodiment is that correlation value calculating means 1 9 of motion vector 
and judgment condition varying means 20 are disposed as shown in Fig. 43. 

In the image motion vector detecting device of thus composed twenty-first embodiment, the operation of the cor- 

30 relation value calculating means 19 of motion vector is same as explained in the eleventh embodiment. The judgment 
condition varying means 20 changes the function of the judgment value to make the judgment condition less severe 
as shown in Fig. 37 when the correlation value C of the motion vector is less than a specific value. In Fig. 37, meanwhile, 
the function of the judgment value is moved parallel, but it is not limitative, and the shape of the function may be varied. 
Next , Fig. 44 is a block diagram of a swing correcting device in a twenty-second embodiment of the invention. 

35 Those same as in Fig. 14, Fig. 43 are identified with same reference numbers, and are not explained herein. 

The blocks of the image motion vector detecting device ol thus composed twenty-second embodiment are same 
in operation as the twenty-first embodiment, and its explanation is omitted. The operation of the swing correcting means 
is also same as explained in the eighth embodiment, and is no described herein. In the twenty-first and twenty-second 
embodiments, the number of detecting regions in the screen may be either four or other. 

40 Next, the motion vector device of a twenty-third embodiment of the invention is described. The configuration of 

the motion vector detecting device of the twenty-third embodiment is shown in Fig. 45. This embodiment is based on 
the motion vector detecting device of the ninth embodiment of the invention , and those same as in the configuration 
of the ninth embodiment in Fig. 28 are identified with same reference numbers, and the explanation is omitted. What 
is different from the ninth embodiment is the correlation value calculating means 19 of motion vector and judgment 

45 condition varying means 20 are disposed as shown in Fig. 45. 

In the image motion vector detecting device of thus composed twenty-third embodiment, the operation of the 
correlation value calculating means 1 9 of motion vector is same as explained in the eleventh embodiment. The judgment 
condition varying means 20 changes to make less severe the judgment condition of the judging means 1 3 when the 
correlation value C of motion vector is less than a specific value. That is, the judgment intervals from p to s in Fig. 24 

50 are moved in the less severe direction of the judgment condition. Or it may be also possible to prepare plural judging 
means differing in the judgment intervals, and change over the judging means depending on the correlation value C. 
The number of changes of judgment condition by the correlation value is not limited to two. 

Next, Fig. 46 is a block diagram of a swing correcting device in a twenty-fourth embodiment of the invention. Those 
same as in Fig. 14, Fig. 45 are identified with same reference numbers, and explanations are omitted. 

55 The blocks of the image motion vector detecting device of thus composed twenty-fourth embodiment are same in 

operation as the twenty-third embodiment, and its explanation is omitted. The operation of the swing correcting means 
is also same as explained in the tenth embodiment, and its explanation is omitted, too. In the twenty-third and twenty- 
fourth embodiments, the number of detecting means in the screen may be either four or other. 
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Next , Fig. 47 is a block diagram of a motion vector detecting device in a twenty -fifth embodiment of the invention. 
Numeral 21 is an image signal input terminal, 22a to 22d are vector detecting circuits of detecting regions, 23a to 23d 
are correlation value detecting parts, 24a to 24d are vector reliability judging means, 25, 26 are means for determining 
the difference of the correlation values, and 27 is motion vector determining means. 

5 in the image motion vector detecting device of thus composed twenty-fifth embodiment, first, an image signal 

consecutive in time for two fields or more is entered in an input terminal 21 . In the screen, four vector detecting regions 
are preliminarily determined as indicated by 209, 210, 211 , 212 in Fig. 2, and in the vector detecting circuits 2a to 2d 
in each detecting region, as for each detecting region between two fields, the difference X I A L I (i.j) of the signal at a 
position deviated by a specified quantity (i j):imin < i< imax, jmin < j < jmax is determined as the correlation value, and 

to the deviation (i'.j*) for giving the minimum value is detected, which is taken as the vector of each region. In the correlation 
value detecting parts 23a to 23d, the minimum, mean and maximum of correlation values are obtained in each detecting 
region. In the vector reliability judging circuit means 24a to 24d, the reliability of each region is judged by the correlation 
value entered from the correlation value detecting part 23a-23d, and the result of judgment and the motion vector of 
each region are delivered to the motion vector determining means 27. In the means 25 for determining the difference 
of the correlation values, the difference of the right and left regions on the screen is determine, while the difference 
between the upper and lower regions on the screen is obtained in the means 26. As the method for determining the 
difference of correlation values in the upper and lower regions or the right and left regions of the screen , either all four 
regions or only two regions in Fig. 2 may be used. Meanwhile, when two diagonal regions are used, the differences of 
the upper and lower regions, and right and left regions may be determined at the same time. The motion vector deter- 

20 mining means 27, when the difference of the correlation values between the regions is less than a specific value, 
determines the intermediate value of the vectors of the regions judged to be reliable (the value positioned in the middle 
when arranged in the size order, or the mean of two central values in the case of an even number) as the motion vector 
of the entire screen, and delivers. If the difference of the correlation values between regions is greater than a specific 
value, the motion vector of the entire screen is regarded as 0. 

25 What is different from the conventional motion vector detecting device is that the motion vector of the entire screen 

is not determined only by the result of judgment of reliability in each detecting region, but is determined from the 
difference of the correlation values between regions, as well as the result of judgment of reliability in each detecting 
region. This point is described in greater detail below. The case of right and left regions is explained below, and the 
case of upper and lower regions is the same and is omitted herein. 

30 Fig. 48 shows the motion vectors of right and left regions, correlation values, and difference of correlation values 

between regions when a moving object enters the screen from left to right, taking the time on the axis of abscissas. In 
Fig. 48, (a) denotes the motion vector of the left region, (b) is the motion vector of the right region, the solid line in (c) 
is the correlation value of the left region, the broken line in (c) is the correlation value of the right region, and (d) denotes 
the difference of correlation values of the right and left regions. The correlation value increases as the moving objects 

3S invades the detecting region, and decreases as the entire region is occupied by the moving object. When the moving 
object leaves the detecting region, the correlation value begins to increase again. In the reliability judging circuit means 
24, the reliability is judged on the basis of the correlation value of (c) in each region, but as shown in the prior art, the 
moving object is often misjudged if judged in each region independently. On the other hand, in the means 25 for 
determining the difference ol the right and left regions of the correlation value, due to the time difference of invasion 

40 of the moving object into the right and left regions, a signal as shown in (d) is obtained, and the difference signal is 
sent to the vector determining means 27 together with the reliability judgment result in each region. In the vector 
determining means 27, if the absolute value of the difference signal of the right and left regions of the correlation values 
becomes larger than a specific value, regardless of the result of the reliability determining means, the motion vector 
of the entire screen is set at 0 for a specific period. As a result, in the reliability determining means in each region, 

45 even if the moving object is misjudged, the invasion of the moving object is detected by the difference signal between 
regions. In this embodiment, meanwhile, the number of detecting regions in the screen is four, but it is not limitative. 

Next, the motion vector detecting device of a twenty-sixth embodiment is described below. The configuration of 
the motion vector detecting device of the twenty-sixth embodiment is shown in Fig. 49. Those same as in Fig. 47 are 
identified with same reference numbers, and are not explained. In Fig. 49, numerals 28a to 28d are vector reliability 

so judging means, and 29 is motion vector determining means. 

In the image motion vector detecting device of thus composed twenty -sixth embodiment, the method of leading 
out the vector of each region and correlation values and the method of determining the difference of correlation values 
between regions are same as in the above-mentioned embodiment, and the explanation is omitted. In the vector reli- 
ability judging means 28a to 28d, the reliability of each region is judged by the correlation values entered from the 

55 correlation value detecting parts 23a to 23d, and besides by the difference of correlation values between regions 
entered from the means 25 for determining the difference of correlation values between right and left regions and from 
the means 26 for determining the difference between the upper and lower regions, and the result of this judgment and 
the motion vector of each region are delivered to the motion vector determining means 29. The motion vector deter- 



17 



10 



1S 



20 



25 



3S 



SO 



55 



EP 0 458 249 B1 ^ 

mining moans 29 determines the intermediate value of the vectors of the regions judged to be reliable (the value 
positioned in the middle when arranged in the size order, or the mean of two central values in the case of an even 
number) as the motion vector of the entire screen, and delivers. 

What is different from the conventional motion vector detecting device is that the reliability of each detecting region 
is not judged by the correlation value only in each detecting region, but is judged by the difference in the correlation 
values between detecting regions as well as the correlation value in each detecting region. This point is explained in 
further detail below. The following explanation relates only to the case of upper and lower regions, and the case of 
right and left regions is the same and is omitted herein. 

When a moving object enters the screen from left to right, the operation is described referring to Fig. 48. In Fig. 
18, (a) to (d) are as explained already in the twenty-fifth embodiment. Now, the difference signal of the right and left 
regions of the correlation values in Fig. 48 (d) is obtained by subtracting the correlation value of the right region from 
the correlation value of the left region. As shown in this diagram, as the moving object passes on the screen, the 
difference signal of the correlation value fluctuates largely to both positive and negative sides. In the reliability judging 
means 28a, 28b (the reliability judging means of the left region), in addition to the correlation values, the difference 
signal of the correlation values is compared with the positive specified level, and the reliability is judged, while in the 
reliability judging means 28c, 28d (the reliability judging means of the right region), in addition to the correlation values, 
the difference signal of the correlation values is compared with the negative specified level, and the reliability is judged." 
In the motion vector determining means 29, as mentioned above, the intermediate value of the vectors of the regions 
judged to be reliable (the value positioned in the middle when arranged in the size order, or the mean of two central 
values in the case of an even number) is determined and delivered as the motion vector of the entire screen. 

In this embodiment, thus, by using the correlation values of the regions and the difference of correlation values 
between regions in the reliability judgment in each region, the judging performance of the reliability for a moving object 
is enhanced. In this embodiment, meanwhile, the number of detecting regions in the screen is four, but it may be also 
other number. 

Next the motion vector detecting device of a twenty-seventh embodiment of the invention is descried below. The 
configuration of the motion vector detecting device in the twenty-seventh embodiment is shown in Fig. 50. Those same 
as in Fig. 47 are identified with same reference numbers and are not explained herein. In Fig. 50, numerals 30a to 30d 
are time variation detecting parts of correlation values, 31a to 31 d are vector reliability judging means, 32, 33 are 
means for determining the difference of the time variation values of correlation values, and 34 is motion vector deter- 
30 mining means. 

In the image motion vector determining device of thus composed twenty-seventh embodiment, the method of 
deducing the vectors of each region and correlation values is same as in the twenty-fifth embodiment, and its expla- 
nation is omitted. In the time variation detecting part 30 of correlation values, the time differential value or the difference 
value after averaging the correlation values is determined. The vector reliability judging circuit means 31 judges the 
reliability of each region from the correlation values entered from the correlation value detecting part 23, and from the 
time variation values of correlation values entered from the time variation detecting part 30 of correlation values, and 
delivers the result of the judgment to the motion vector determining means 34, together with the motion vector of each 
region. In the means 32 for determining the difference of the time variation value of correlation values, the difference 
as to right and left regions of the screen is determined, while the difference as to upper and lower regions of the screen 
is determined in the means 33. As the method of determining the difference of the time variation values of the correlation 
of the upper and lower or right and left regions of the screen, either all four regions, in Fig. 2 or only two regions may 
be used. Or when two diagonal regions and used, the differences of the upper and lower, and right and left regions 
may be detected at the same time. The motion vector determining means 34 determines the intermediate value of the 
vectors of the regions judged to be reliable (the value positioned in the middle when arranged in the size order, or the 
mean of two central values in the case of an even number), when the difference of the time variation values of the 
correlation values between regions is less than a specific value, as the motion vector of the entire screen, and delivers. 
When the difference of time variation values of correlation values between regions is larger than a specific value, the 
motion vector of the entire screen is 0. 

What is different here from the conventional motion vector detecting device is that the motion vector of the entire 
screen is not determined only by the result of judgment of reliability in each detecting region, but by the difference of 
the time variation values of correlation values between regions, as well as the result of judgment of reliability in each 
detecting region. This point is described in further detail below. Hereunder, only the case of right and left regions is 
discussed, and the case of upper and lower regions is the same and its explanation is omitted. 

Fig. 51 shows the motion vectors of right and left regions, time variation values of correlation values, and difference 
of time variation values of correlation values between regions, when a moving object enters the screen from left to 
right, taking the time on the axis of abscissas. In Fig. 51, (a) denotes the motion vector of the left region, (b) is the 
motion vector of the right region, (c) is the time variation value of correlation value of the left region, (d) is the time 
variation value of correlation value of the right region, and (e) denotes the difference of time variation values of corre- 
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lation values between the right and left regions, when determining the difference between the regions, however, the 
negative portion of the time variation value of the correlation value in each region was assumed to be 0. In the reliability 
judging means 31, the reliability is judged in each region, on the basis of the correlation value, and the time variation 
value of the correlation values shown in Fig. 51 (c), (d), but even when the time variation value of the correlation value 
is used in the reliability judgment, same as explained in the prior art, the moving object may be often misjudged when 
judged in each region independently. 

Then , in the means 32 for determining the difference of the right and left regions of the time variation values of 
the correlation values , owing to the time difference of the moving object entering the right and left regions, a signal as 
shown in (e) is obtained, and the difference signal is sent to the vector determining means 34, together with the result 
of judgment of reliability in each region. In the vector determining means 34 .when the absolute value of the difference 
signal of the right and left regions of the time variation values of the correlation values exceeds a specific value, the 
motion vector of the entire screen is set at 0 for a specific period regardless of the result of the reliability judging means. 
As a result, in the reliability judging means 31a to 31 d in each region, even if the moving object is misjudged, the 
invasion of the moving object may be delected by the difference signal between the regions. In this embodiment, the 
number of detecting regions in the screen is four, but it may be other number. Besides, when determining the difference 
between regions, the negative portion of the time variation values ot the correlation values in each region is assumed 
to be 0, but it is not necessarily set at 0. 

The motion vector detecting device of the twenty-eighth embodiment of the invention is described. The configu- 
ration of the motion vector detecting device of the twenty-eighth embodiment is shown in Fig. 52. Those same as in 
Fig. 50 are identified with same reference numbers, and explanations are omitted. In Fig. 52, numerals 35a to 35d are 
vector reliability judging means, and 36 is motion vector determining means. 

In the image motion vector detecting device of thus composed twenty-eighth embodiment, the method of deducing 
the vectors of each region and correlation values and the method of determining the difference between regions of the 
time variation values of correlation values are same as in the twenty-fifth and twenty-seventh embodiments, and the 
explanation is omitted. In the vector reliability judging means 35a to 35d, the reliability of each region is judged from 
the correlation values entered from the correlation values detecting parts 23a to 23d, time variation values of correlation 
values entered from the time variation value detecting parts 30a to 30d of correlation values, and the difference signal 
of the time variation values of the correlation values between regions entered from the means 32 for determining the 
difference of right and left regions of time variation values of correlation values and from the means 33 for determining 
the difference of the upper and lower regions, and the result of judgment and the motion vector of each region and 
delivered to the motion vector determining means 36. The motion vector determining means 36 determines the inter- 
mediate value of the vectors in each region judged to be reliable (the value positioned in the middle when arranged in 
the size order, or the means of two central values in the case of an even number) as the motion vector of the entire 
screen, and delivers. 

What is different from the conventional motion vector detecting device is that the reliability of each detecting region 
is not judged from only the correlation values of detecting regions and time variation value of correlation values, but is 
judged from the difference in the time variation values of the correlation values in the detecting regions, as well as the 
correlation values of each detecting region and time variation value of correlation values. This point is described in 
further detail below. Only the case of right and left regions is mentioned herein, and the case of upper and lower regions 
is the same and is not explained. 

When a moving object enters the screen from left to right, the operation is explained by referring to Fig. 51 . In Fig. 
51 , (a) to (e) are as explained in the twenty-seventh embodiment. Now, the difference signal of the right and left regions 
of the time variation values of the correlation values in Fig. 51 (e) is obtained by subtracting the time variation value 
of the correlation value of the right region from that of the left region, and the negative portion of the time variation 
value of the correlation value in each region is supposed to be 0. As the moving object passes on the screen as shown 
herein, the difference signal of the time variation value of the correlation value fluctuates largely to the positive and 
negative side. Accordingly, in the reliability judging means 35a, 35b (the reliability judging means of the left region), in 
addition to the correlation value and the time variation value of the correlation value, the difference signal of the time 
variation value of the correlation value is compared with the positive specified level, and the reliability is judged, and 
in the reliability judging means 35c, 35d (the reliability judging means of the right region), in addition to the correlation 
value and the time variation value ot correlation value, the difference signal of the time variation value of correlation 
value is compared with the negative specified level to judge the reliability. In the motion vector determining means 36, 
as mentioned above, the intermediate value of the vector in each region judged to be reliable (the value positioned in 
the middle when arranged in the size order, or the mean of two central values in the case of an even number) is 
determined and delivered as the motion vector of the entire screen. 

In this embodiment, thus, in judgment or reliability of each region, in addition to the correlation value of the each 
region and time variation value of correlation value, by using the time variation value of the correlation values between 
regions, the judging performance of reliability of the moving object may be enhanced. In this embodiment, meanwhile, 
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the number of detecting regions in the screen is four, but it is not limitative. Besides, when determining the difference 
between regions, the negative portion of the time variation value of correlation values individual regions was supposed 
to be 0, but it is not always necessary to set at 0. 

Next Fig. 53 is a block diagram of a swing correcting device in a twenty-ninth embodiment of the invention. In Fig. 
5 53, numeral 37 is a motion vector detecting device, and 38 is swing correcting means. Incidentally, the structure of the 
motion vector detecting device 37 may be any one of those explained in the twenty -fifth to twenty-eighth embodiments. 

In thus composed image motion vector detecting device of the twenty-ninth embodiment, the operation is same 
as in the twenty-fifth to twenty-eighth embodiments, and its explanation is omitted. 

The swing correcting means 38, when receiving an image with a large fluctuation as indicated by 226, 227 in Fig. 
io 5, moves the screen of the image parallel from 229 to 228 in the direction 231 of correcting the movement, on the basis 
of the motion vector 230 entered from the motion vector detecting device 37, with respect to the input image signals 
of the (n-1)-th field 226 and the n-th field 227, and manipulates the screen by enlarging or the like by interpolation or 
the like, thereby delivering image signal 232, 233 in the size of one screen small in fluctuation. 

Thus, according to this embodiment, whether the moving object has invaded the region or not is judged, in each 
is detecting region, by the correlation value and the time variation value of correlation value, and the moving object is 
detected by finding the correlation value between regions and the difference of time variation value of correlation values, 
and the motion vector ol the entire screen is determined. On the basis of thus determined motion vector of the entire 
screen, the image signal memory means and CCD reading position are controlled, thereby correcting the swing of the 
screen. As a result, even if a moving object occupying the majority or whole ol the screen passes through the screen, 
20 malfunction of correcting the screen in a wrong direction Irom the direction intended by the operator due to interruption 
of correction is avoided. 

Next the motion vector detecting device of a thirtieth embodiment of the invention is explained. The configuration 
of the motion vector detecting device of the thirtieth embodiment is shown in Fig. 54. Numeral 301 is an image signal 
input terminal, 302a to 302c are vector detecting circuits of each detecting region, 303a to 303c are correlation value 

25 detecting parts, 304a to 304c are mean calculating parts, 305a to 305c are time variation value detecting parts, 306 
to 308 are means for determining the difference of the time variation values between regions, 309 is moving object 
detecting means, 310 is reliability judging means, and 311 is motion vector determining means. 

In the image motion vector detecting device of thus composed thirtieth embodiment, first, an image signal consec- 
utive in time for at least two fields is entered into the input terminal 301. In the screen, three vector detecting regions 

30 are preliminarily determined as indicated by 312, 313, 314 in Fig. 55, and in vector detecting circuits 302a to 302c of 
the detecting regions, the difference Z I A L I of the signal at the position deviated by a specified quantity (ij) irnin 
< i< imax, jmin < j < jmax is determined as the correlation value in each detecting region between two fields, and the 
deviation (Fj 1 ) for giving the minimum value of the value is detected, and it is regarded as the vector of each region. In 
the correlation detecting parts 303a to 303c, the minimum, mean and maximum of correlation values are determined 

35 in each detecting region. In the mean calculating parts 304a to 304c, the time mean is determined for the minimum of 
the correlation values. In the time variation value detecting parts 305a to 305c, the time differential value or the differ- 
ence value after averaging the minimum values of the correlation values determined. In the means 306 for determining 
the difference of the time variation values between regions, the difference between the left region and right region of 
the screen is determined, white the difference between the middle region and right region of the screen is determined 

■*o in 307, and the difference between the middle region and left region of the screen is determined in 308. Numeral 309 
is for detecting the moving object on the basis of the difference signal between regions obtained by 306 to 308. The 
vector reliability judging means 310 judges the reliability in each region from the correlation value entered from the 
correlation value detecting part 303 and the moving object detecting signal from the moving object detecting means 
309, and the result of judgment and the motion vector of each region are delivered to the vector determining means 

45 311 . The motion vector determining means 311 determines the intermediate value of the vectors of each region judged 
to be reliable by the reliability judging means (the value positioned in the middle when arranged in the size order, or 
the mean of two central values in the case of an even number) as the motion vector of the entire screen and delivers. 

Here, what is different from the conventional motion vector detecting device is that the motion vector of the entire 
screen is not determined only by the reliability judgment result in each detecting region, but by the difference in the 

so time variation values of correlation values between regions as well as the result of judgment of reliability in each de- 
tecting region. This point is further described below. 

Fig. 56 shows the motion vectors of left, middle and right detecting regions, output signals of the time variation 
value detecting parts 305a to 305c of the minimum value of correlation values, and the difference of the time variation 
values between regions, when a moving object enters the screen from left to right, taking the time on the axis of 

55 abscissas. In Fig. 56, (a) denotes the motion vector of the left region, (b) is the motion vector of the middle region, (c) 
is the motion vector of the right region, (d) is the time variation value of the left region, (e) is the time variation value 
of the middle region, (f) is the time variation value of the right region, (g) is the difference in the time variation value 
between the right and left regions, and (h) denotes the difference in time variation value between the middle and right 
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regions. When determining the difference between regions, however, the negative portion of the time variation value 
of the correlation value in each region was assumed to be 0. In the means 306 for determining the difference of time 
variation value between the right and left regions, and the means 307 for determining the difference between the middle 
and right regions, due to the time difference of the moving object entering the regions, the difference signals 31 5, 316 
s as indicated in (g) : (h) are obtained, and are sent to the moving object detecting means 309. In the moving object 
detecting means 309, after the difference signals 315, 316 satisfy the following condition 1 , when condition 2 is met 
within a specific time, it is judged that the moving object has invaded the screen. 

Condition 1 : difference signal 315 > a and p 1 > difference signal 316 > (J 2 

10 Condition 2: difference signal 316 > 7 

This is the explanation of the case of the moving object entering the screen from left to right, but if entering from 
right to left, the moving object may be similarly detected. In this case, instead of the difference of the time variation 
value between the middle and right regions, the difference of the time variation value between the middle and left 
is regions is used. 

In the reliability judging means 310, the reliability is judged by using the correlation value ol each region, and the 
reliability is judged on the basis of the moving object detecting signal from the moving object detecting means 309. 
Concerning the technique of judging the reliability using the correlation value, either the conventional technique to the 
technique used in the foregoing embodiments of the invention may be employed. As the technique of judging the 

20 reliability on the basis of the moving object detecting signal, when the moving object is detected by the moving object 
detecting means 309, the reliability is negated in all regions. The motion vector determining means 311 determines 
the intermediate value of the vectors of each region judged to be reliable by the reliability judging means 310 as men- 
tioned above as the motion vector of the entire screen, and delivers it. 

In such constitution of the embodiment of the invention as described herein, even if the reliability judging means 

25 by the correlation value in each region fails to detect the moving object, the invasion of the moving object may be 
detected by the difference signal between regions. Therefore, the motion vector due to camera shake or the like may 
be detected correctly. 

In the embodiment, the number of detecting regions in the screen is three, but this is not limitative. Furthermore, 
in this embodiment, the difference between the regions is determined in the lateral direction in order to detect the 
30 moving object moving in the lateral direction, but to detect a moving object moving in the vertical direction, the difference 
between the regions may be determined in the vertical direction. An example with five detecting regions is given in 
Fig. 57. 

In the embodiment, when determining the difference between regions, the negative portion of the time variation 
value of correlation values in each region is supposed to be 0, but it is not always required to be 0. 
55 Next the motion vector detecting device of a thirty -first embodiment of the invention is descried. The configuration 

of the motion detecting device of the thirty-first embodiment is shown in Fig. 58. Those same as in Fig. 54 are identified 
with same reference numbers, and the explanation is omitted. What is different from the thirtieth embodiment is the 
moving object detecting means 317 and the reliability judging means 318, and only these two points are described 
below. 

<?0 An example of detecting a moving object entering the screen from the left side is describe below. In the screen, 

three vector detecting regions are determined as indicated by 31 2, 31 3, 31 4 in Fig. 55. In the means 306 for determining 
the difference between the left and right regions of the time variation value, and in the means 307 for determining the 
difference of the middle and right regions, due to the time difference of the moving object entering each region, difference 
signals 315, 316 are obtained as shown in Fig. 56 (g), (h) : and are sent to the moving object detecting means 317. In 

^5 the moving object detecting means 317, after the difference signals 315, 316 satisfy the following condition 1 , when 
the condition 2, condition 3, and condition 4 are satisfied within a specific time, it is judged that the moving object has 
invaded the screen. 

Condition 1: difference signal 315 > a and (31 > difference signal 316 > p2 

so Condition 2: difference signal 316 > 71 

Condition 3: difference signal 316 > 72 

Condition 4: difference signal 316 > 73 

however, yl < 72 < 73 

55 in the reliability judging means 318, while judging the reliability by using the correlation value of each region, the 

reliability is judged on the basis of the moving object detecting signal from the moving object detecting means 31 7. As 
the technique for judging the reliability by using the correlation value, either the conventional method or the technique 
used in the other embodiments of the invention may be employed. As the technique for judging the reliability on the 
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basis of the moving object detecting signal, when the condition 2 is satisfied by the moving object delecting means 
317, the vector delecting region 312 in Fig. 55 is judged to be not reliable, and when the condition 3 is satisfied, the 
vector detecting region 313 is judged to be not reliable, and when the condition 4 is satisfied, the vector detecting 
region 314 is judged to be not reliable. However, when the condition 4 is not satisfied within a specific time, the vector 
5 detecting regions judged to be not reliable in the condition 2 and condition 3 are judged to be reliable. Thus, in this 
embodiment, it is characteristic that the reliability is negated sequentially from the region invaded by the moving object. 
The motion vector determining means 311 determines the intermediate value of the vector in each region judged to 
be reliable by the reliability judging means 318 as mentioned above as the motion vector of the entire screen, and 
delivers it. 

to in such constitution of the embodiment of the invention as described above, even if the moving object cannot be 

detected by the reliability judging means by the correlation value in each region, the invasion of the moving object can 
be detected by the difference signal between regions. Therefore, the motion vector due to camera shake or the like 
can be corrected detected. 

In the embodiment, the number of detecting regions in screen is three, but it is not limitative. Furthermore, in this 

1$ embodiment, the difference between regions is determined in the lateral direction to detect the object moving in the 
lateral direction, but the difference between regions may be determined in the vertical direction to detect an object 
moving in the vertical direction. Incidentally, the condition 4 of the moving object detecting means 31 7 of the embodiment 
may not be absolutely necessary, and without it, the vector detecting region 31 3 in Fig. 55 is judged to be not reliable 
when either the condition 2 or condition 3 is satisfied. In the embodiment, when determining the difference between 

20 regions, the negative portion of the time variation value of correlation value in each region is supposed to be 0, but it 
is not always necessary to suppose to be 0. 

Next the motion vector detecting device of a thirty-second embodiment of the invention is described below. The 
configuration of the motion vector detecting device of the thirty-second embodiment is shown in Fig. 59. Those same 
as in Fig. 54 are identified with same numbers, and are not explained herein. In Fig. 59, numeral 319 is reliability 

25 judging means, and 320 is vector determining means. 

As an example of invasion of a moving object from the left side of the screen : only different points from the thirtieth 
embodiment are explained below. In the reliability judging means 319, the reliability is judged in each region by using 
the correlation value of each region. The technique of judging the reliability by using the correlation value may be either 
the conventional technique or the technique used in the other embodiments of the invention. The motion vector deter- 

30 mining means 320, as mentioned above, determines the intermediate value of the vector of each region judged to be 
reliable by the reliability judging means 319 as the motion vector of the entire screen and delivers it, but when the 
moving object is detected by the moving object detecting means 309, regardless of the result of the reliability judging 
means 319, the motion vector of the entire screen is assumed to be 0 for a specific period. As a result, even if the 
moving object is misjudged by the reliability judging means in each region, the invasion of the moving object is deter- 

35 mined by the moving object detecting means, and the motion vector due to camera shake or the like may be correctly 
detected. 

Next is explained the motion vector detecting device of a thirty-third embodiment of the invention. The configuration 
of the motion vector detecting device of the thirty-third embodiment is shown in Fig. 60. Those same as in Fig. 54 are 
identified with same reference numbers, and the explanation is omitted. In Fig. 60 : numeral 321 is reliability judging 
40 means. 

As an example of invasion of a moving object from the left side of the screen , only different points from the thirtieth 
embodiment are described below. In the reliability judging means 321, the reliability is judged in each region by using 
the correlation value of each region, and when Ihe moving object invading from the left is detected by the moving object 
detecting means 309, the vector detecting region 312 in Fig. 55 is judged to be not reliable. The technique of judging 

4 $ the reliability by using the correlation value may be either the conventional method or the technique used in the other 
embodiments of the invention. Furthermore, when detecting the moving object by the moving object detecting means 
309, the reliability judging condition of the reliability judging means 321 is varied so as to raise the detecting sensitivity 
of the moving object. As a result, even if the moving object is misjudged in the reliability judging condition of the ordinary 
reliability judging means, the invasion of the moving object is detected by the moving object detecting means, and by 

50 varying the reliability judgment condition, the motion vector due to camera shake can be corrected detected. 

The motion vector detecting device of a thirty-fourth embodiment of the invention is described below. The config- 
uration of the motion vector detecting device of the thirty-fourth embodiment up to the moving object detecting means 
is shown in Fig. 61 . As for the overall configuration of the motion vector detecting device, on the basis of the moving 
object detecting signal from the moving object detecting means 323 shown in Fig. 61 , it may be composed by using 

55 either one of the reliability judging means or motion vector determining means explained in the thirtieth to the thirty- 
third embodiments. Therefore here only the moving object detecting means 323 is explained. Those same as in Fig. 
54 are identified with same reference numbers, and the explanations are omitted. In Fig. 61, numeral 322 is vector 
difference detecting means between regions, and 323 is moving object detecting means. 
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In the vector difference detecting means 322 between regions, the absolute value of the difference of the motion 
vector of the left region (312 in Fig. 55) of the vector detecting region and the motion vector of the right region (314 in 
Fig. 55) is determine. In the moving object detecting means 323, the moving object detecting conditions explained in 
the thirtieth and thirty-first embodiment are further combined with the new detecting conditions by the vector difference 
signal between regions from the means 322 for detecting vector difference between regions. An example of adding 
the new conditions to the moving object detecting conditions in the thirtieth embodiment is shown below. In the moving 
object detecting means 322, after satisfying the following condition 1 , when the condition 2 is satisfied within a certain 
period, it is judged that the moving object has invaded the screen. 

Condition 1 : difference signal 31 5 > a and pi > difference signal 316 > p2 

Condition 2: difference signal 316 > 7 and vector difference signal between regions > 5 

Likewise, the conditions may be also added to the moving object detecting conditions in the thirty-first embodiment. 

Thus, by adding the difference of the motion vector between regions to the condition, the detecting condition of 
the moving object becomes severe, and the possibility of mistaking something for a moving object is lowered. 

Fig. 62 is a block diagram of an image swing correcting device including a motion vector detecting device in a 
thirty-fifth embodiment of the invention. Numeral 41 is an image signal input terminal, 42 is a vector detecting circuit 
of each region, 43 is still state judging state, 44 is reliability judging means of vector, 45 is judgment result leading 
means, and 46 is motion vector determining means. Numeral 47 is swing correcting means, which has the same 
function as the swing correcting means 208 in Fig. 1 . 

In the image motion vector detecting device of thus composed thirty-fifth embodiment, first, an image signal con- 
secutive in time for at least two fields is entered in the input terminal 41 . In the vector detecting circuit 42 of each region, 
four vector detecting regions are determined in the screen as indicated by 209, 210 211 , 212 in Fig. 2, and as for each 
detecting region between two fields, the difference Z I A L I (i,j) of the signal at the position deviated by a specified 
quantity (i,j):imin < i< imax, jmin < j < jmax is determined as the correlation value, and the deviation (i\j') for giving the 
minimum value of the value is detected, and it is taken as the motion vector Vk of each detecting region (the number 
of detecting regions: k = 1, 2, 3, 4). The motion vector of each detecting region is delivered to the still state judging 
means 43. 

The still state judging means 43 judges if the motion vector in each detecting region is still or not : and the result 
of this judgment is delivered to the judgment result leading means 45 together with the motion vector of each detecting 
region. The still state judging means 43 judges that the motion vector in the detecting region is still when the vector 
Vk is within the constant C for consecutive 10 times or n times (n: a natural number) in the time series, for example: 

Sk= {Vk(t) < C} n {Vk(t-1 ) < C} o 
(Vk(t-2) < C) n {Vk(t-3) < C) n 
{Vk(t-4) < C} o (Vk(t-5) < C} n 
{Vk(t-6) < C} n {Vk(1-7) < C) n 
{Vk(t-B) < C} n (Vk(t-9) < C} 

where 

Sk: judgment result (1 if true, 0 if false) (k=1 ,2,3,4) 
t: time 
C: constant 
rv AND 

Vk: motion vector of each detecting region (k=1 ,2,3,4) 

AS the still state condition, besides, it may be also considered to judge that the motion vector is still when it is within 
the constant C by m times out of n times (n > m) (m: a natural number). 

The vector detecting circuit 42 of each region determines the maximum, mean and minimum of the correlation 
values, and delivers them, together with the value of the motion vector, to the vector reliability judging means 44. The 
vector reliability judging means 44 judges the reliability of each detecting region from the input values from the vector 
detecting circuit 42 of each region, and delivers the result of judgment to the judgment result leading means 45 together 
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with the motion vector of each region. In the judgment result leading means 45, if it is judged that there is at least one 
motion vector standing still among four vector detecting regions, this judgment result and the motion vectors of detecting 
regions are delivered to the vector determining means 46. If there is no motion vector standing still, the result of judgment 
of the reliability judging means and motion vectors of detecting regions are delivered to the vector determining means. 
The motion vector determining means 46 determines the motion vector of the entire screen from the judgment result 
of each detecting region and the motion vector of each detecting region. 

This operation is shown in a flow chart in Fig. 63. Starting from step 101 , step 102 corresponds to 42 in Fig. 62, 
step I03 to 44 in Fig. 62, step 104 to 43 in Fig. 62 steps 105, 106, 107 to 45 in Fig. 62, step 108 to 45 in Fig. 62, and 
the motion vector is delivered at step 1 09. 

Fig. 64, Fig. 65 are diagrams showing practical examples. Intervals (a) to (e) in Fig. 65 correspond to (a) to (e) in 
Fig. 64. Fig. 64 shows the correlation value between the screen and each detecting region when a moving object 52 
enters the screen, and Fig. 65 shows the motion vector 59 detected at this time. In Fig. 65, numeral 60 denotes a 
motion vector of camera, and it is 0 vector. Numeral 56 is a motion vector of a moving object, and it is nearly constant. 
Numerals 57, 58 are vectors detected in detecting regions 48, 49, and depending of the manner of relation between 
the moving object and the detecting regions, the vector 56 comprising the motion of the moving object, and other wrong 
vectors are detected. Numeral 59 is a motion vector delivered from the motion vector determining means 46. 

First, as shown in Fig. 64 (a), when both the background and the moving object 52 are present in a certain detecting 
region 48, this detecting region is judged to be not reliable depending on the state of the correlation value 53 as shown 
in Fig. 64 (a). It is desired that the detecting region 49 be judged to be reliable, but depending on the manner of 
reproduction(image signal) of the background, the reliability is negated as shown in Fig. 64 (a), (b). The operation of 
the detecting regions 50, 51 is same as that of 48, 49, and the explanation is omitted. Next, as shown in Fig. 64 (b), 
when occupying the majority or whole of a certain detecting region 48, the motion vector 57 of the detecting region 
becomes a sum motion vector adding the motion of the moving object 52, and it is judged to be reliable from the state 
of the correlation value 55. Furthermore, at this time, the detecting region 49 is not reliable. Here, however, the detecting 
region 49 is judged to be still in the motion vector by the still state judging means 43, and the motion vector 57 is 
ignored by the judgment result leading means 45, and the motion vectors of the detecting regions 49, 51 are used in 
the final determination of the motion vector. As the moving object moves along with the passing of the time, the back- 
ground and the moving object 52 are both present in the detecting region 48 again (this is (c) though not shown in Fig. 
64), and the no-reliability state is established as shown in Fig. 64 (d), (e). In (c), (d), (e) t however, since still vectors 
are present, the motion vectors detected at (a) to (e) in Fig. 65 are as shown by 59 in Fig. 65, so as not to be influenced 
by the motion of the object. 

Thus, according to the embodiment, if there is at least one motion vector judged to be still by the still state vector 
judging means, the still judgment result is given priority over the judgment result of the reliability judging means, and 
therefore if the reliability judgment means misjudges, it is finally possible to avoid output of wrong vector due to invasion 
of the subject or the like. 

In the thirty-fifth embodiment, meanwhile, when there is a certain uniform brightness or color image such as the 
sky and the wall in a certain detecting region in the screen , if the screen swings due to camera shake or the like, the 
motion vector of that region obtained from the vector detecting circuit 42 of each region often delivers an uncertain 
value. At this time, if the still state judging circuit 43 judges that the uniform image is standing still, it is impossible to 
correct when the screen swings due to camera shake or the like. Accordingly, the still state judging means 43 may be 
further improved as follows. Fig. 66 shows its screen and the mean of the correlation value at that time. Numerals 86, 
87, 88, 89 are detecting regions. Fig. 66 (a) is a spontaneous scene, (c) is the mean at that time, (b) is the sky scene 
with uniform image detecting regions 87, 88, and (d) is the mean of the detecting regions 87, 88. The mean of the 
correlation values is obtained by obtaining the difference £ I A L I (i,j) of the signal at the position deviated by a specified 
quantity (i,j):imin < i <imax, jmin < j < jmax as the correlation value in each detecting region between two fields, and 
averaging the obtained values. Generally, when the screen is a spontaneous scene as in Fig. 66 (a), the mean of the 
detecting regions is a high value as in Fig. 66 (c). In the case of a uniform screen as in the detecting regions 87, 88 in 
Fig. 68 (b), on the other hand, the correlation values (the signal difference X I A L I (i,j)) become small in the entire 
region of imin < i imax, jmin < j < jmax, showing smaller values than Fig. 66 (c), as indicated in Fig. 66 (d). When the 
mean is smaller than a specific value C\ it is enough when the detecting regions 87, 88 are judged to be not still. 

The still state judging means judges that the motion vector of the detecting region is still when the vector Vk and 
the mean satisfy the specified conditions consecutively 10 times or n times (n: a natural number) in the time series, 
for example: 

Sk = {Vk(t) < C} n {Vk(t-1) < C} n 
{Vk(t-2) < C} n (Vk(t-3) < C} n 
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{Vk(l-4) < C} n {Vk(t-5) < C} o 
(Vk(t-6) < C) n {Vk(t-7) < C} n 
[Vk(t-8) < C} n {Vk(1-9) < C} n 
{Avek(t)>C} o 
{Avek(M)>C , }o 
{Avek(t-2)>C'}n 
{Avek(t-3)>C'}n 
{Avek(t-4)>C'}n 
{Avek(t-5)>C'}n 
jAvek(t-6) > C'} n 
{Avek(t-7)>C'}n 
{Avek(t-S) > C'} o 
{Avek(t-9)> C'} 

where 



Sk: judgment result (1 if true, 0 if false) (k=l ,2,3,4) 

t: time 

C, G': constants 

n: AND 

Vk: motion vector of each detecting region (k-1 ,2,3,4) 

Avek: mean of each detecting region (k=1, 2,3,4) 



Thus, according to the embodiment, if there is a uniform image of the screen in a certain detecting region, that 
detecting region is judged not to be still by the still state judging means, and by correcting according to the detecting 
regions of non-uniform image, a stable and easy-to-see screen is obtained. 

Fig. 67 is a block diagram of an image swing correcting device including a motion vector detecting device in a 
thirty-sixth embodiment of the invention. Numeral 61 is an image signal input terminal. Numeral 62 is a vector detecting 
circuit of each region, 63 is minimum judging means, 64 is vector reliability judging means, 65 is judgment result leading 
means, 66 is motion vector determining means, and 67 is swing correcting means. 

In thus composed thirty-sixth embodiment, the vector detecting circuit 62 of each region, reliability judging means 

64, vector determining means 66, and swing Correction means 67 are same in operation as the vector detecting circuit 
42 of each region, reliability judging means 44, vector determining means 46 and swing correcting means 47 in the 
thirty-fifth embodiment. 

The minimum judging means 64 judges if the motion vector in each detecting region is standing still or not, and 
delivers the result of judgment, together with the motion vector of each region, to the judgment result leading means 

65. The minimum judgment is to judge the detecting region having the minimum value among the plural motion vectors 
of detecting regions. 

In the judgment result leading means 65, when the reliability judging means 64 judges that the reliability is absent 
at least in one detecting region, the judgment result of the minimum judging means 63 is employed, and is delivered 
to the motion vector determining means 66. In the vector determining means 66, the minimum value among the motion 
vectors of the detecting regions is taken as the motion vector of the entire screen. When the reliability judging means 
64 judges that all detecting regions are reliable, the judgment result of the reliability judging means is employed, and 
is delivered to the motion vector determining means 66. The motion vector determining means 66 takes the mean of 
the motion vectors of the detecting regions as the motion vector of the entire screen. 
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This operation is shown in a flow chart in Fig. 68. Starting with step 110, step 111 corresponds to 62 in Fig. 67, 
step 112 to 64 in Fig. 67, step 11 3 to 63 in Fig. 67, steps 114, 115, 116 to 65 in Fig. 67, step 117 to 66 in Fig. 67, and 
the motion vector is delivered at step 118. 

Same as in the thirty-fifth embodiment, practical effects are explained by referring to Fig. 64 and Fig. 65. First, as 
shown in interval (a) in Fig. 64, when both the background and the moving object 52 are present in a certain detecting 
region 48, that detecting region is judged to be not reliable depending on the state of the correlation value 53 as shown 
in Fig. 64 (a). It is desired that the detecting region 49 to judged to be reliable, but depending on the manner of repro- 
duction of the background, the reliability is negated as shown in Fig. 64 (a), (b). Accordingly, the minimum judgment 
result is employed by the judgment result leading means 65. The operation of the detecting regions 50, 51 is same as 
that of the detecting regions 48, 49 and is hence not explained herein. Next, as shown in Fig. 64 (b), when occupying 
the majority or whole of the detecting region 48, the vector 57 in Fig. 65 of that detecting region becomes a sum motion 
vector adding the motion of the moving object 52, and the reliability is affirmatively judged from the state of the corre- 
lation value 55. At this time, the detecting region 49 is not reliable. In this case, however, since the detecting region 
49 is in the minimum value of the detecting regions, the motion vector 57 is ignored, and the motion vectors of the 
detecting regions 49, 51 are finally used in the determination of motion vector. Furthermore, when the moving object 
52 moves with the passing of the time, both the background and the moving object 52 enter the detecting region 48 
again (this is (c) although not shown in Fig. 64), and it is followed by no-reliability state as shown in Fig. 64 (d), (e). In 
the intervals (c), (d), (e), however, the minimum vector is employed, and the motion vectors detected at intervals (a) 
to (e) in Fig. 65 become as shown in 59 in Fig. 65, being not influenced by the motion of the subject. 

Thus, according to the embodiment, if there is at least one vector judged to be not reliable by the reliability judging 
means, the minimum judgment result is given priority over the judgment result of the reliability judging means, and 
therefore if the reliability judging means misjudges, output of wrong vector may be finally avoided. 

In the judgment result leading means 65, meanwhile, the minimum judgment result may be employed only when 
the reliability judgment result is a mixture of being reliable and being not reliable. In other words, it may be designed 
not to correct the swing when all reliability judgments of detecting regions are absent. 

Incidentally, the minimum judging means 63 may judge n motion vectors selected sequentially from the smallest 
among the motion vectors of detecting regions , to be minimum. The vector determining means 66 determines the 
motion vector of the entire screen from n values. 

Fig. 69 is a block diagram of swing correcting device of image including motion vector detecting device in a thirty- 
seventh embodiment of the invention. Numeral 68 is an image signal input terminal. Numeral 69 is a vector detecting 
circuit of each region, 70 is similarity judging means, 71 is vector region judging means, 72 is judgment result leading 
means, 73 is vector determining means, and 74 is swing correcting means. 

In thus composed thirty-seventh embodiment., the operation of the vector detecting circuit 69 of each region, reli- 
ability judging means 71 , vector determining means 73, and swing correcting means 74 are same as those of the vector 
detecting circuit 42 of each region, reliability judging means 44, vector determining means 46, and swing correcting 
means 47 in the thirty-fifth embodiment, respectively. 

In the similarity judging means 70, the degree of similarity is calculated. To determine the similarity, the difference 
portion of the motion vectors of the detecting regions is calculated. For example, it may be expressed as follows: 

Similarity = 
{IV1I-IV2I} + {IV1I-IV3I} 
+ {IV1I-IV4I} + {IV2I-IV3I} 
+ {IV2I - IV4I} + {IV3I - IV4I} 

where 

Vi: (i = 1 , 2, 3, 4) motion vector of the detecting region, 
i is the number of detecting regions. 

The smaller the similarity, the more similar are the motion vectors of the detecting regions. In the similarity judging 
means 70 , when motion vectors of all detecting regions are similar, the result of judgment of all vectors is true (1). 
Otherwise, the result is false (0). The result of judgment, the degree of similarity, and motion vectors of detecting regions 
are delivered to the judgment result leading means 72. 

In the judgment result leading means 72, the judging means is selected on the basis of the similarity. 
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if similarity ^ C, the similarity judgment result is used, 
if similarity > C, the reliability judgment result is used. 
C: constant 



5 This operation is shown in the flow chart in Fig. 70. Starting with step 119, step 1 20 corresponds to 69 in Fig. 69, 

step 121 to 71 in Fig. 69, step 122 to 70 in Fig. 69, steps 123, 124, 125 to 72 in Fig. 69, step 126 to 73 in Fig. 69, and 
a motion vector is delivered at step 127. 

A practical example is explained in Fig. 71, 72. Fig. 71 shows the screen before correction with camera shake, 
detecting regions 75 : 77 and their correlation value 80, detecting regions 76, 78 and their correlation value 81. The 
10 operation of detecting regions 77 s 78 is same as that of 75, 76, and the explanation is omitted. Numeral 79 is an 
obstacle. Fig. 72 shows the motion vector and similarity in Fig. 71 . In Fig. 72, numeral 84 is a motion vector of camera, 
and it is swinging vertically about 0 vector. Numeral 83 is a motion vector detected from the detecting region 75, and 
the motion vector 84 due to camera shake or the motion of the moving object 79 or other wrong vector is detected. 
Numeral 82 is a motion vector detected from the detecting region 76, and the motion vector 84 due to camera shake 
i^ is detected. Numeral 85 is a motion vector of the entire screen delivered from the vector determining means 73. Intervals 
(a) to (d) in Fig. 71 correspond to (a) to (d) in Fig. 72. 

First, in Fig. 71 (a) to (c). from Fig. 72, it is known that the state is 
Similarity C 

and therefore the similarity judgment result is employed. By the vector determining means 73, the mean of all motion 
20 vectors in the detecting regions becomes the motion vector of the entire screen. 

In Fig. 71 (b), the reliability judgment is suddenly no reliability in all detecting regions due to the appearance(image 
signal ) of the background, and by this judgment alone, the swing is not corrected, but since the state is 
Similarity ^ C 

as known from Fig. 72, the similarity judgment result is employed. Next, in interval (d) in Fig. 71 , the obstacle 79 has 
25 entered, and hence the state is 
Similarity > C 

and the reliability judgment result is employed. Hence, the motion vector of the detecting region 75 is employed. As a 
result, the motion vector of the entire screen is as shown in 85 in Fig. 72, and the vector correcting only the camera 
shake is obtained. 

30 Thus, according to the embodiment, when the motion vectors of the detecting regions are judged to be similar by 

the similarity judging means, the entire screen is swinging in a same direction, and therefore the screen swing must 
be corrected. Here, in the case on the basis of the similarity, motion vectors of all detecting regions are employed by 
the judgment result leading means 72, and are delivered to the vector determining means 73. To the contrary, if not 
similar, it is highly possible that an obstacle has entered the screen, and the detecting region containing the obstacle 

3S should not be used in correction, and therefore the reliability judging means 71 is used. In such constitution, only the 
camera shake is corrected, and a stable and easy-to-see image is obtained. 

In the thirty-fifth, thirty-sixth and thirty-seventh embodiments, meanwhile, the number of detecting regions in the 
screen is four, but it is not limitative. Besides, the method of judging the reliability of the motion vectors of detecting 
regions is described in detail, but this is not necessarily to be exactly so, and in judgment, not only the state of the 

40 correlation value at that moment or the value of the vector, but also the state of the preceding correlation value, the 
vector value or judgment result may be used together. 

Or, in the motion vector detecting device, all of the still state judging means, minimum judging means and similarity 
judging means may be employed. 

Fig. 73 is a block diagram of an image swing correcting device including a motion vector detecting device in a 

45 thirty-eighth embodiment of the invention. Numeral 131 is an image signal input terminal. Numeral 132 is a vector 
detecting circuit in each region, 133 is weighting processing means, and 134 is swing correcting means, of which 
f unction is same as that of the swing correcting means 208 in Fig. 1 . 

In the image motion vector detecting device of thus composed thirty-eighth embodiment, first, an image signal 
consecutive in lime for at least two fields is led into the input terminal 131 . In the vector detecting circuit 1 32 of each 

so region, as shown in Fig. 74, plural vector detecting regions 1 35 or 1 38 are determined in the screen, and the detecting 
regions are divided into multiple subdivisions having representative points as explained in the prior art (Fig. 2). An 
image signal consecutive in time of two fields is entered. The difference from the signal at a position deviated by a 
specific quantity (i,j): imin < t< tmax, jmin < j < jmax between two fields with respect to representative points of each 
subdivision is obtained as the correlation value individually, and the sum of subdivisions is determined. The correlation 

55 value is obtained in the same formula as in the prior art. 
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70 



20 



Correlation value = 



n 

I I AL I (i.j) 



where 



X I A L I (i.j) : absolute value of difference of signal between coordinates and representative point 

n: number of subdivisions in one detecting region 



Detecting the deviation for giving the minimum value of correlation values, it is taken as the motion vector Vk 
(k = 1, 2, .... n; n: number of detecting regions) of each detecting region. The motion vector of each detecting region 
is delivered to the weighting processing means 1 33. 

In the weighting processing means 1 33, by calculating the motion vector of each detecting region by using weight 
is coefficient, the motion vector of the entire screen is delivered. The weighting processing means 1 33 may be expressed 
by a formula of weighting mean, for example, 



= 2 (ak * Vk) / Sak 



where 



25 n: number of detecting regions 

ak: weight coefficient 

Vk: motion vector of each detecting region 

V: motion vector of entire screen 

30 Two practical examples are shown in Fig. 74 (a), (b). Numerals 1 35, 1 38 are detecting regions, 1 36, 1 39 are motion 

vectors of detecting regions, 137, 140 are weight coefficients of detecting regions. In Fig. 74 (a) ; the screen is divided 
into five detecting regions, and in Fig. 74 (b), into 16 detecting regions. In both (a) and (b), the weight coefficient is 0 
in the central part ot the screen, and is larger at the end portions of the screen. Suppose, as shown in Fig. 75 (a), (b), 
a moving object (a car) enters. Numerals 141, 145 are detecting regions, 142, 146 are motion vector of detecting 

3S regions, 143, 147 are weight coefficients of detecting regions, and 144, 148 are moving objects (cars). Fig. 75 (a) 
corresponds to Fig. 74 (a), and Fig. 75 (b) to Fig. 74 (b). In Fig. 75 (a), the moving object is located nearly in the center. 
Since the weight coefficient of the central detecting region is 0, the motion vector of the moving object will not affect 
the motion vector of the entire screen. In Fig. 75 (b), the motion vector of the moving object is detected in regions (V3, 
V6, V7, V10, V11 , V15). Among them, since the weight coefficient is 0 in V7 : V7, V10, V11 , there will be no effect on 

40 the motion vector of the entire screen. As for V3, V1 5, since the value becomes relatively small due to weighting mean, 
and there is no notable effect. 

Thus, according to the embodiment, the middle of the screen is the motion of the subject, and it is expected that 
the motion due to camera shake is present at the end portion of the screen, and when the weight coefficient is set 
larger at the end portion of the screen. At this time, the central part of the screen may not be always 0. When the motion 

45 vector is weighted and averaged on the basis of the weight coefficient: a motion vector similar to the vector of the 
camera shake may be obtained by simple calculation. 

Fig. 76 is a block diagram of an image swing correcting device including a motion vector detecting device in a 
thirty-ninth embodiment of the invention. Numeral 149 is an image signal input terminal. Numeral 1 50 is a vector de- 
tecting circuit of each region, 151 is a reliability judging means 152 is weighting processing means, and 153 is swing 

50 correcting means having the same function as the swing correcting means 208 in Fig. 1 . 

In the image motion vector detecting device of thus composed thirty-ninth embodiment, first, an image signal 
consecutive in time for at least two fields is entered into the input terminal 149. In the vector detecting circuit 150 of 
each region, same as in the thirty-ninth embodiment, the motion vector is determined. As shown in Fig. 77 (a), plural 
vector detecting regions 155 are determined in the screen, and the detecting regions are further divided into multiple 

$5 subdivisions having representative points explained in the prior art (Fig. 2). An image signal consecutive in time for 
two fields is entered. As for representative point of each subdivision, the difference from the signal at a position deviated 
by a specified quantity (ij): imin < i < imax, jmin < j < jmax between two fields is determined as the correlation value, 
and the sum of the subdivisions is calculated. The correlation value is obtained in a same formula as in the prior art. 
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n 

Correlation = 2 | AL | (i f j) 

k=l 

where 

I A L I (ij): absolute value of difference of signal between coordinates and representative point 

n: number of subdivisions in one detecting region 

Detecting the deviation (i\j') for giving the minimum of correlation values, it is determined as the motion vector of 
each detecting region (k = 1, 2, .... n; n: number of detecting regions). The vector detecting circuit 150 of each region 
determines the minimum, mean and maximum of the correlation values, and delivers them, together with the value of 
the motion vector of the vector reliability judging means 151. In the vector reliability judging means 151, from the 
minimum, mean and maximum of the correlation values of detecting regions, the reliability of the vector is judged. The 
reliability judgment result and the motion vector of the detecting region and delivered to the weighting processing 
means 152. 

The weighting processing means 152 calculates on the basis of the weight coefficient and motion vector in the 
regions judged to be reliable by the reliability judging means 151. The weighting processing means 152 may be ex- 
pressed, for example, in the following weighting mean expression. 



V = E (ak * V k) / if ak 

k - I k « 1 

where 

k: the number of the detecting region judged to be reliable 

(excluding the numbers not reliable) 
n: number of detecting regions 
ak: weight coefficient 
Vk: motion vector of each detecting region 
V: motion vector of entire screen 

Fig. 77 (a), (b) show practical examples. Fig. 77 (a) is divided into 16 detecting regions, and the weight coefficient 
is given. Numeral 155 is a detecting region, 154 is a motion vector in each detecting region, 156 is a weight coefficient 
of each detecting region, and 157 is a moving object (a car). In (a), the motion vectors of the moving object (V3, V6, 
V7, V10, V1 1 V1 5) are detected. Of them, V6, V7, V10, V11 are 0 in the weight coefficient, and will not affect the motion 
vector of the entire screen. As for V3, VI 5, as shown in shaded area in (b), the reliability is negatively confirmed by 
the reliability judging means 151 ,and they will not be employed. Therefore, the weighting mean is calculated by the 
motion vectors of VI, V2, V4, V5, V8, V9, V12, V13, V14, V16, and the motion vector of the entire screen is determined. 

Thus, according to the embodiment, the middle of the screen is the motion of the subject, and it is expected that 
the motion by camera shake is present in the end portion of the screen, and therefore the weight coefficient is increased 
in the end portions of the screen. Furthermore, by calculating the weighting mean of only the motion vector of the 
detecting regions judged to be reliable by the reliability judging means, the motion vector similar to the vector of the 
camera shake may be deduced by a simple calculation. Meanwhile, it is not necessarily required that the central portion 
of the screen be 0. 

Fig. 78 is a block diagram of an image swing correcting device including a motion vector detecting device in a 
fortieth embodiment of the invention. Numeral 158 is on image signal input terminal. Numeral 158 is an image signal 
input terminal. Numeral 158 is a vector detecting circuit of each region, 160 is classifying(ctustering) means, 161 is 
camera shake group judging means, 162 is motion vector determining means, and 163 is swing correcting means, 
which functions same as the swing correcting means 208 in Fig. 1. 

In the image motion vector detecting means of thus composed fortieth embodiment, first an image signal consec- 
utive in time for at least two fields is entered in the input terminal 1 58. In the vector detecting circuit 159 of each region, 
as shown in 165 in Fig. 79 (a), plural vector detecting regions are preliminarily determined in the screen, and the 
detecting regions are further divided into multiple subdivisions having the representative points as shown in the prior 
art (Fig. 2). An image signal consecutive in time for two fields is entered. As for the representative points of each 
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subdivision, the difference from the signal at the position deviated by a specified quantity imin < i< imax, join < j 
< jmax between two fields is determined as the correlation value, and the sum of subdivisions is obtained. The corre- 
lation value is determined in the following equation, same as in the prior art. 

5 

n 

Correlation value = 2 | | (i,j) 

k=l 

10 

where 

I A L l(i,j) : absolute value of difference of signal between coordinates (i,j) and representative point 

n: number of subdivisions in one detecting region 

75 

Detecting the deviation (i\j*) giving the minimum value of correlation values, it is obtained as the motion vector Vk (k 

= 1,2 n; n: number of detecting regions) of each delecting region. The motion vector of each detecting regbn is 

delivered to the classifying processing means 160. 

The classifying means 160 classifies the motion vectors of detecting regions. There are many classifying tech- 
no niques, and any one may do, but an example of hierarchical classifying is explained in this embodiment. That is the 
motion vectors are grouped sequentially from the smallest distance between direction of motion and magnitude of 
motion vectors. Furthermore, those small in the distance between groups are combined to make up one group, and 
the number of groups is decreased. The distance between groups is expressed by the maximum distance among 
mutual motion vectors between groups, for example, as shown below. 

25 

Dnax - max | Vi- V j| 
i, J 

30 

where 

Vi (i = 1 , 2, n): motion vectors in a certain group 

Vj (j = 1 , 2, .... m): motion vectors in a different group 

3S j, j; the numbers of detecting regions in a group 

The groups are merged sequentially from the smallest distance Dmax between groups. There are many groups initially 
but as grouping is promoted, the number of groups decreases. Classifying is continued until those within specific 
distance are regarded to belong to a same group. Or classifying may be stopped on the basis of the number of groups. 

40 The camera shake group judging means 161 selects groups of camera shake motion vectors among plural groups. 

Motion vectors before invasion of the moving object may be regarded as a camera shake group. 

The motion vector determining means 1 62 determines the motion vector of the swing correction by averaging the 
motion vectors in a group selected by the camera shake group judging means 161 . 

Fig. 79 (a), (b) are practical examples. Fig. 79 (a) divides the screen into 16 detecting regions. Numeral 164 is a 

*s motion vector of detecting region, and 165 is a detecting region. Suppose a moving object (a man) 166 enters as in 
(a). The man is walking, while waving hand, from left to right of the screen. Therefore, the motion vector of the man is 
fluctuating. As the motion vectors of the man, V5, V6, V7, V8, V9, V10, V11 , V12 are detected. On the other hand, as 
the camera shake motion vectors, VI, V2, V3, V4, V13, VI 4, V15, V16 are detected. Drawing these motion vectors 
by matching the start points of there , result in Fig. 79 (b). The motion vector is divided into two groups, as in (b), by 

so using the classifying technique. Two groups are expressed in the detecting regions as shown in spotted area (group 
1 ) and shaded area (group 2) in Fig. 80. Some of the detecting regions do not belong to any group. Which group should 
be used as the correction vector for camera shake may be judged by employing group 1 which is the motion vector 
before invasion of the man. 

Thus, according to the embodiment, by classifying (clustering) motion vectors in detecting regions into plural groups 
55 on the basis of the direction or magnitude or their differential value, and employing one of the groups as the motion 
vector of camera shake, a motion vector similar to the vector of camera shake may be obtained. 

Fig. 81 is a block diagram of an image swing correcting device including a motion vector detecting device in a 
forty-first embodiment of the invention, in which numeral 169 is an image signal input terminal. Numeral 170 is a vector 
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detecting circuit of each region, 171 is reliability judging means, 172 is classifying mean, 173 is camera shake group 
judging means, 174 is motion vector determining means, and 174 is swing correcting means, which has the same 
f unction as the swing correcting means 208 in Fig. 1 . 

In the image motion vector detecting device of thus composed forty-first embodiment, first, an image signal con- 

5 secutive in tine for at least two fields is entered into the input terminal 169. In the vector detecting circuit 170 of each 
region, the motion vector is individually obtained. As shown in Fig. 62 (a), plural vector detecting regions 177 are 
preliminarily determined in the screen, and the detecting regions are further divided into multiple subdivisions having 
representative points explained in the prior art (Fig. 2). An image consecutive in time for two fields is entered. As for 
the representative point of each subdivision, the difference from the signal at a position deviated by a specified quantity 

io (i,j): jmin < i imax, jmin < j < jmax between two fields is determined as the correlation value, and the sum of the sub- 
divisions is calculated. The correlation value is determined, same as in the prior art, in the following equation. 



15 



20 



n 



Correlation = 2 I A L | 
k=l 



where 



I AL I (i,j) : absolute value of difference of signal between coordinates (i,j) are representative point 

n: number of subdivisions is one detecting region 

Detecting the deviation (i\j') for giving the minimum of correlation values, it is obtained as the motion vector of each 
25 detecting region Kv (k = 1, 2, n; n; number of detecting regions). The vector detecting circuit 170 of each region 
determines the minimum, mean and maximum of the correlation values, and delivers them, together with the value of 
the motion vector, to the vector reliability judging means 171. In the vector reliability judging means 171, from the 
minimum, mean and maximum of correlation values of each detecting region, the reliability of the vector is judged. The 
result of reliability judgment and the motion vector of detecting region are delivered to the classifying means 172. 
30 The classifying means 1 72 clusters (classifies) the motion vectors of detecting regions judged to be reliable by the 

reliability judging means 171 . There are many classifying methods, and any one will do, and an example of hierarchical 
classifying is described in this embodiment. That is, those small in the distance between motion vectors (difference in 
direction and magnitude) are grouped together. Furthermore, those small in the distance between groups are merged 
to make up one group, and the number of groups is decreased. The distance between groups is expressed, for example, 
35 by the maximum distance among mutual motion vectors between groups as follows. 

Dmax - max | V i- V j | 

where 

Vi (i = 1, 2, .... n): motion vector in a certain group 

4 $ Vj (j = 1, 2, .... m): motion vector in other group 

i. j: the numbers of detecting regions in a group 

Groups are merged sequentially from the smallest distance between groups Dmax. Initially there are many groups, 
but as grouping is promoted, the number decreases. Classifying is continued until those within specific distance are 

50 regarded to belong to a same group. Or classifying may be stopped on the basis of the number of groups. 

The camera shake group judging means 173 selects a group of motion vector of camera shake, among plural 
groups. The motion vector before invasion of the moving object maybe regarded as the group of camera shake. 

The motion vector determining means 174 determines the motion vector of swing correction by averaging the 
motion vectors within the group selected by the camera shake group judging means 173. 

55 Fig. 82(a), (b) show practical examples. In Fig. 82(a), the screen is divided into 16 detecting regions, and a moving 

object (a man) has invaded. The man walks while waving hand and enters the screen from left to right. As the motion 
vectors of the man, V5, V6, V7, V8, V9, V10, V11 VI 2 are detected. As the motion vectors of camera shake, VI, V2, 
V3, V4, V13, V14, V15, V16 are detected. As shown in the shaded area in Fig. 82 (a), since the motion vectors V5, 
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V6, V9, V10 are judged to be not reliable by the reliability judging means 171 , classifying is effected by using the motion 
vectors excluding them. Fig. 82 shows a detecting region grouped by classifying. The region of the camera shake is 
shown in spotted area (group 1), and the region of the man is shaded area (group 2). To judge which group should be 
used as the correction vector for camera shake, group I which is the motion vector before invasion of the man should 
be selected. 

Thus, according to the embodiment, by classifying (clustering) only the motion vectors in the detecting regions 
judged to be reliable by the reliability judging means on the basis of the direction or magnitude of the motion vector in 
each detecting region and employing one of the groups as the motion vector of the camera shake, a motion vector 
similar to the camera shake vector may be deduced. 

In this invention, as described herein, even if a moving object similar to each region or larger than that enters, 
although the vector could not be detected in the prior art, only the motion vector due to the shake of the video camera 
may be detected as the motion vector of the screen selectively from the motion vectors of regions, and conventionally 
when a moving object similar to or even larger than the screen enters, a vector containing the motion of the moving 
object was detected by mistake, while the detecting is automatically interrupted and detecting of wrong vector is pre- 
vented in the invention. The swing correcting device of the invention is very wide in the range of correction of shake 
due to the moving object and very rarely malfunctions if exceeding this range, where as the correcting range of swing 
due to moving object was small in the prior art and malfunctions often occurred when exceeding the range and it was 
far from practicable. In addition, as compared with the prior art, the invention may be very easily-realized by hardly 
increasing the circuits and others, and its practical effect is great. 

Moreover, according to the invention, if a moving object similar to or even larger than each region should enter, 
although the moving object could not be detected in the prior art, the moving object may be detected very sensitively 
by making use of the correlation value between regions or the time variation value of the correlation values. Hence, 
only the motion vector due to shake of the video camera can be selectively detected as the motion vector of the screen 
out of the motion vectors of regions, and even when a moving object similar to or even larger than the screen should 
enter, the detection is automatically interrupted and detection of wrong vector is prevented, while the vector containing 
the motion of the moving object was detected by mistake conventionally. 

Still more, in the invention, should the reliability judgment be wrong in the event of invasion of a moving object, 
only the still motion vector or the motion vector due to the shake of video camera may be detected as the motion vector 
of the entire screen selectively from motion vectors of detecting regions, and when a moving object invades, although 
a wrong vector as detected because the motion of the moving object was added conventionally, the detection is auto- 
matically interrupted, and detection of wrong vector is prevented. 

In the invention, furthermore, if the motion of the moving object and motion of the camera shake coexist, by setting 
the weight coefficient in each detecting region, since the presence of motion vector due to camera shake is expected 
more in the end portion of the screen, the weight coefficient is increased in the detecting region in the end portion of 
the screen, and by calculating the weighted mean of the motion vector on the basis of this weight coefficient, a motion 
vector approximating the vector of camera shake may be deduced by a simple calculation. 

By classifying the motion of the moving object and motion due to the camera shake by the classifying technique, 
the motion vector of the camera shake may be obtained more accurately. 

What is more, when this method is applied by using only the detecting region judged to be reliable by the reliability 
judging means, the performance is further enhanced. 



Claims 

1. An image motion vector detecting device comprising: 

means (23a-d, 42, 69, 132, 150, 159, 170) for determining a correlation value in a specific deviation in each 
detecting region of plural detecting regions disposed in a screen, 

means (30a-d) for determining a time variation value of the correlation values, 

means (32, 33) for determining a difference of the time variation values of correlation values between right 
and left or upper or lower detecting regions in a screen, 

means (22a-d, 42, 69, 1 32, 150, 159, 170) for determining a motion vector in each detecting region from the 
correlation values, 

means (35a-d, 44 64) for judging a reliability of the motion vector in each detecting region on the basis of the 
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correlation values of the detecting regions, the time variation values ol correlation values, and the difference 
of time variation values of correlation values between regions, and 

means (36) for determining a motion vector of an entire screen by using the motion vector of each detecting 
region on the basis of the reliability. 

An image motion vector detecting device according to claim 1 , characterized by 

the reliability judging means (44, 64, 1 51 , 1 71 ) judging the reliability of the motion vector of the detecting region 
by a value of the motion vector or the correlation value or their combination, 

still state judging means (43) for judging a still state of motion vector of each detecting region by using the 
motion vector, 

means (45) for leading out a final judgment result from the still state judging means and the reliability judging 
means, and 

means (46) for determining a motion vector of an entire screen from the motion vector of each detecting region 
on the basis of the obtained final judgment result. 

An image motion vector detecting device according to claim 1 or 2 ; characterized by 

minimum judging means (63) for judging a motion vector having a relatively small value among the motion 
vectors of detecting regions, 

means (65) for leading out a final judgment result from the minimum judging means and the reliability judging 
means, and 

means (66) for determining a motion vector of an entire screen from the motion vector of each detecting region 
the basis of the obtained final judgment result. 

An image motion vector detecting device according to claim 1 , characterized by 

state judging means (71 ) for judging a state of motion vector of detecting region by the value of motion vector 
or the correlation value or their combination, 

similarity judging means (70) for judging a similarity of motion vectors of detecting regions, 

means (72) for leading out a final judgment result from the similarity judging means and the state judging 
means, and 

means (73) for determining a motion vector of an entire screen from the motion vector of each detecting region 
on the basis of the obtained final judgment result. 

An image motion vector detecting device according to claim 2, characterized in that 

said still state judging means (43) judges that the motion vector is standing still when there are at least two or more 
motion vectors led out in the time series within a specific range. 

An image motion vector detecting device according to claim 3, characterized in that 

said minimum judging means (63) judges only one minimum value among the motion vectors of detecting regions. 
An image motion vector detecting device according to claim 4, characterized in that 

said state judging means (71) has the function of the reliability judging means (44, 64) for judging a reliability of 
the motion vectors in detecting regions by the motion vector value or the correlation value or their combination. 

An image motion vector detecting device according to claim 1 , characterized by 

weighting processing means (133) for determining a motion vector of an entire screen from the motion vectors 
and weight coefficients set in each detecting region. 
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9. An image motion vector detecting device according to claim 1 or 2, characterized by 

weighting processing means (1 52) for determining a motion vector of an entire screen from weight coefficients set 
in each detecting region and the motion vector of the detecting region, judged to be reliable by the reliability judging 
means. 

10. An image motion vector detecting device according to claim 1 , characterized by 

classifying means (160) for classifying the motion vectors into groups on the basis of a magnitude or direction 
or their differential value, 

camera shake group judging means (161) for selecting a group for determining a motion vector of an entire 
screen from groups classified by the classifying means, and 

means for determining a motion vector (162) of the entire screen from the motion vector of the group selected 
by the camera shake group judging means. 

11. An image motion vector detecting device according to claim 1 , characterized by 

classifying means (172) for classifying the motion vectors of the detecting regions judged to be reliable by the 
reliability judging means into groups on the basis of a magnitude, direction or their differential value, 

camera shake group judging means (173) for selecting a group for determining a motion vector of an entire 
screen from a group classified by the classifying means, and 

means (174) for determining a motion vector of the entire screen from the motion vector of the group selected 
by the camera shake group judging means. 

12. An image swing correcting device comprising: 

image signal memory means or CCD for at least one field, 

an image motion vector detecting device according to at least one of claims 1 to 11 , and 

reading position of the image signal memory means or CCD being controlled on the basis of a motion vector 
detected by the image motion vector detecting device. 



Patentaneprucho 

1. Erfassungsvorrichtung fur den Bewegungsvektor eines Bildes, mit 

einer Einrichtung (23a-d, 42, 69, 132, 150, 159, 170) zum Bestimmen eines Korrelationswerts in einer be- 
stimmten Abweichung in jedem Erfassungsbereich mehrerer auf einem Bildschirm angeordneter Erfassungs- 
bereiche, 

einer Einrichtung (30a-d) zum Bestimmen eines Zeitveranderungswerts der Korrelationswerte, 
einer Einrichtung (32, 33) zum Bestimmen eines Unterschieds der Zeitverande rungs we rte der Korrelations- 
werte zwischen rechten und linken Oder oberen und unteren Erfassungsbereich en auf einem Bildschirm, 
einer Einrichtung (22a-d, 42. 69, 132, 150. 159, 170) zum Bestimmen eines Bewegungsvektors aus den Kor- 
relationswerten in jedem Erfassungsbereich, 

einer Einrichtung (35a-d, 44, 64) zur Beurteilung einer Zuverlassigkeit des Bewegungsvektors in jedem Er- 
fassungsbereich auf der Grundlage der Korrelationswerte der Erfassungsbereiche, der Zeitveranderungswer- 
te der Korrelationswerte und des Unterschieds der Zeitabweichungswerte der Korrelationswerte verschiede- 
ner Beretche, und 

einer Einrichtung (36) zum Bestimmen eines Bewegungsvektors eines gesamten Bildschirms unter Verwen- 
dung des Bewegungsvektors eines jeden Erfassungsbereichs auf der Grundlage der Zuverlassigkeit. 

2. Erfassungsvorrichtung fur den Bewegungsvektor eines Biides nach Anspruch 1 , dadurch gekennzeichnet, daG die 
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Zuverlassigkeitsbeurteilungseinrichtung (44, 64, 151, 171) die Zuverlassigkeit des Bewegungsvektors eines Er- 
fassungsbereichs anhand eines Werts des Bewegungsvektors Oder des Korrelationswerts oder deren Kombination 
beurteilt. 

eine Stillstandszuslandserkennungseinrichtung (43) vorgesehen ist zum Erkennen eines Stillstandszustands 

des Bewegungsvektors eines jeden Erfassungsbereichs unter Verwendung des Bewegungsvektors, 

eine Einrichtung (45) vorgesehen ist zum Ausgeben eines endguttigen Beurteilungsergebnisses aus der 

Stillstandszustandsbeurteilungseinrichtung und der Zuverlassigkeitsbeurteilungseinrichtung, und 

eine Einrichtung (46) vorgesehen ist zum Bestimmen eines Bewegungsvektors eines gesamten Bildschirms 

aus dem Bewegungsvektor eines jeden Erfassungsbereichs aut der Grundlage des gewonnenen endgultigen 

Beurteilungsurteils. 

3. Ertassungsvorrichtung fOr den Bewegungsvektor eines Bildes nach Anspruch 1 oder 2, gekennzeichnet durch eine 
Minimumerkennungseinrichtung (63) zum Erkennen eines Bewegungsvektors mit einem vergleichsweise kleinen 
Wert unter den Bewegungsvektoren der Erfassungsbereiche, 

eine Einrichtung (65) zum Ausgeben eines endgultigen Erkennungsergebnisses aus der Minimumerkennungs- 
einrichtung und der Zuverlassigkeitsbeurteilungseinrichtung, und 

eine Einrichtung (66) zum Bestimmen eines Bewegungsvektors eines gesamten Bildschirms aus den Bewe- 
gungsvektoren der Erfassungsbereiche auf der Grundlage des gewonnenen endgultigen Erkennungsergeb- 
nisses. 

4. Ertassungsvorrichtung fur den Bewegungsvektor eines Bildes nach Anspruch 1 , gekennzeichnet durch 

eine Zustandsbeurteilungseinrichtung (71) zum Beurleilen eines Zustands eines Bewegungsvektors eines 
Erfassungsbereichs anhand des Werts des Bewegungsvektors oder des Korrelationswerts oder ihrer Kombi- 
nation, eine Ahnlichkeitsbeurteilungseinrichtung (70) zum Beurteilen der Ahnlichkeit von Bewegungsvektoren 
von Erfassungsbereichen, 

eine Einrichtung (72) zum Ausgeben eines endgultigen Beurteilungsergebnisses aus der Ahnlbhkeitsbeurtei- 
lungseinrichtung und der Zustandsbeurteilungseinrichtung, und 

eine Einrichtung (73) zum Bestimmen eines Bewegungsvektors eines gesamten Bildschirms aus den Bewe- 
gungsvektoren der Erfassungsbereiche auf der Grundlage des gewonnenen endgultigen Beurteilungsergeb- 
nisses. 

5. Erfassungvorrichtung fur den Bewegungsvektor eines Bildes nach Anspruch 2, dadurch gekennzeichnet, daB die 
Stillstandszustandserkennungseinrichtung (43)erkennt, daBder Bewegungsvektor stillsteht, wenn in derzeitlichen 
Folge drei oder mehr Bewegungsvektoren innerhalb eines bestimmten Bereichs ausgegeben werden. 

6. Ertassungsvorrichtung fur den Bewegungsvektor eines Bildes nach Anspruch 3, dadurch gekennzeichnet, daB die 
Minimumerkennungseinrichtung (63) in den Werten der Bewegungsvektoren der Erfassungsbereiche lediglich ei- 
nen Minimalwert erkennt. 

7. Ertassungsvorrichtung fur den Bewegungsvektor eines Bildes nach Anspruch 4, dadurch gekennzeichnet, daB die 
Zustandsbeurteilungseinrichtung (71) die Funktion der Zuverlassigkeitsbeurteilungseinrichtung (44, 64) zur Beur- 
teilung der Zuverlassigkeit der Bewegungsvektoren in den Erfassungsbereichen anhand des Bewegungsvektor- 
werts oder des Korrelationswerts oder deren Kombination hat. 

8. Ertassungsvorrichtung f Or den Bewegungsvektor eines Bildes nach Anspruch 1 , gekennzeichnet durch eine Ge- 
wichtungsverarbeitungseinrichtung (133) zum Bestimmen eines Bewegungsvektors eines gesamten Bildschirms 
aus den Bewegungsvektoren und Gewichtungskoeffizienten, die fur die Erfassungsbereiche festgesetzt sind. 

9. Ertassungsvorrichtung fur einen Bewegungsvektor eines Bildes nach Anspruch 1 oder 2, gekennzeichnet durch 
eine Gewichtungsverarbeitungseinrichtung (152) zum Bestimmen eines Bewegungsvektors eines gesamten Bild- 
schirms aus Gewichtungskoeffizienten, die f Or jeden Erf assungsbereich festgesetzt sind, und aus den Bewegungs- 
vektoren derjenigen Erfassungsbereiche, die durch die Zuverlassigkeitsbeurteilungseinrichtung als zuverlassig 
beurteilt sind. 

10. Ertassungsvorrichtung fOr den Bewegungsvektor eines Bildes nach Anspruch 1 , gekennzeichnet durch 
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eine Klassifizierungseinrichtung (160) zum Ktassrfizieren des Bewegungsvektors in Gruppen auf der Grund- 
lage des Betrags oder der Richtung Oder ihres Differenzwertes, 

eine Kamerabewegungsgruppenbeurteilungseinrichtung (161 ) zum Wahlen einer Gruppe zum Bestimmen ei- 
nes Bewegungsvektors eines gesamten Bildschirms aus durch die Klassifizierungseinrichtung klassifizierlen 
Gruppen, und 

eine Einrichtung zum Bestimmen eines Bewegungsvektors (162) des gesamten Bildschirms aus dem Bewe- 
gungsvektor der Gruppe, die von der Kamerabewegungsgruppenbeurteilungseinrichtung gewahlt wurde. 

11. Erfassungsvorrichtung fur den Bewegungsvektor eines Bildes nach Anspruch 1 , gekennzeichnet durch 

eine Klassifizierungseinrichtung (1 72) zum Klassifizieren des Bewegungsvektors der Ertassungsbereiche, die 
durch dieZuverlassigkeitsbeurteilungseinrichtung ais zuverlassig beurteitt sind, in Gruppen auf der Grundlage 
eines Betrags, der Richtung oder eines Differenzwerts, 

eine Kamerabewegungsgruppenbeurteilungseinrichtung (173) zum Wahlen einer Gruppe zum Bestimmen ei- 
nes Bewegungsvektor seines gesamten Bildschirms aus einer Gruppe, die von der Klassifizierungseinrichtung 
klassifiziert wurde, und 

eine Einrichtung (174) zum Bestimmen eines Bewegungsvektors des gesamten Bildschirms aus dem Bewe- 
gungsvektor der Gruppe, die durch die Kamerabewegungsgruppenbeurteilungseinrichtung gewahlt wurde. 

12. Bildschwenkkorrekturvorrichtung mit 

einer Bildsignalspeichereinrichtung oder einem CCD fOr zumindest ein Feld, 

einer Erfassungsvorrichtung fur den Bewegungsvektor eines Bildes nach einem der Anspruche 1 bis 11 , und 
wobei die Leseposition in der Bildsignalspeichereinrichtung oder im CCD auf der Grundlage des von der Er- 
fassungsvorrichtung fOr den Bewegungsvektor des Bildes erfaGten Bewegungsvektors gesteuert wird. 

Revendications 

1. Dispositif de detection de vecteur do mouvement d'image comprenant : 

un moyen (23a a d, 42, 69, 1 32. 1 50, 1 59, 1 70) pour determiner une valeur de correlation dans une deviation 
specifique dans chaque region de detection de multiples regions de detection disposers dans un ecran, 

un moyen (30a a d) pour determiner une valeur de variation dans le temps des valeurs de correlation, 

un moyen (32, 33) pour determiner une difference des valeurs de variation dans le temps des valeurs de 
correlation entre les regions de detection drorte et gauche ou superieure ou inferieure dans un ecran, 

un moyen (22a a d, 42, 69 : 1 32, 1 50, 1 59, 1 70) pour determiner un vecteur de mouvement dans chaque region 
de detection a partir des valeurs de correlation, 

un moyen (35a a d, 44, 64) pour juger de la fiabilite du vecteur de mouvement dans chaque region de detection 
sur la base des valeurs de correlation des regions de detection, des valeurs de variation dans le temps des 
valeurs de correlation et de la difference des valeurs de variation dans le temps des vateurs de correlation 
entre les regions, et 

un moyen (36) pour determiner un vecteur de mouvement d'un ecran entier en utilisant le vecteur de mouve- 
ment de chaque region de detection sur la base de la fiabilite. 

2. Dispositif de detection de vecteur de mouvement d'image selon la revendication 1 , caractertse par 

le moyen de jugement de fiabilite (44, 64, 151, 171) jugeant de la fiabilite du vecteur de mouvement de la 
region de detection par une valeur du vecteur de mouvement ou de la valeur de correlation ou de leur com- 
binaison, 

un moyen de jugement d'etat fixe (43) pour juger cTun etat fixe du vecteur de mouvement de chaque region 
de detection en utilisant le vecteur de mouvement, 
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un moyen (45) pour sortir un resultat de jugement final a partir du moyen de jugement d'etat fixe et du moyen 
de jugement de fiabilite, et 

un moyen (46) pour determiner un vecteur de mouvement efun 6cran entier a partir du vecteur de mouvement 
de chaque region de detection sur la base du resultat de jugement final obtenu. 

3. Dispositif de detection de vecteur de mouvement d'image selon la revendication 1 ou 2, caracterise par 

un moyen de jugement de valeur minimale (63) pour juger un vecteur de mouvement ayant une valeur rela- 
trvement faible panmi les vecteurs de mouvement des regions de detection, 

un moyen (65) pour sortir un resultat de jugement final a partir du moyen de jugement de valeur minimale et 
du moyen de jugement de fiabilite, et 

un moyen (66) pour determiner un vecteur de mouvement d'un 6c ran entier a partir du vecteur de mouvement 
de chaque region de detection sur la base du resultat de jugement final obtenu. 

4. Dispositif de detection de vecteur de mouvement d'image selon la revendication 1 , caracte>is£ par 

un moyen de jugement d'etat (71) pour juger d'un etat du vecteur de mouvement de la region de detection 
par la valeur du vecteur de mouvement ou de la valeur de correlation ou de leur combinaison, 

un moyen de jugement de similitude (70) pour juger de la similitude des vecteurs de mouvement des regions 
de detection, 

un moyen (72) pour sortir un resultat de jugement final a partir du moyen de jugement de similitude et du 
moyen de jugement d'etat, et 

un moyen (73) pour determiner un vecteur de mouvement cfun ecran entier a partir du vecteur de mouvement 
de chaque region de detection sur la base du resultat de jugement final obtenu. 

5. Dispositif de detection de vecteur de mouvement d'image selon la revendication 2, caracterise en ce que 

(edit moyen de jugement d'etat fixe (43) juge que le vecteur de mouvement demeure fixe lorsqu'il existe au moins 
deux ou plus vecteurs de mouvement sortis dans la serie temporelle a I'inteYieur cTune plage sp6cifique. 

6. Dispositif de detection de vecteur de mouvement d'image selon la revendication 3, caracterise en ce que 

ledrt moyen de jugement de valeur minimale (63) juge seulement d'une valeur minimale parmi les vecteurs de 
mouvement des regions de detection. 

7. Dispositif de detection de vecteur de mouvement d'image selon la revendication 4, caracterise en ce que 

I edit moyen de jugement d'etat (71 ) a la fonction du moyen de jugement de fiabilite (44, 64) pour juger de la fiabilite 
des vecteurs de mouvement dans les regions de detection par la valeur du vecteur de mouvement ou la valeur 
de correlation ou de leur combinaison. 

8. Dispositif de detection de vecteur de mouvement d'image selon la revendication 1 , caracterise par 

un moyen de traitement de ponderation (133) pour determiner un vecteur de mouvement d'un ecran entier a partir 
des vecteurs de mouvement et des coefficients de poids etablis dans chaque region de detection. 

9. Dispositif de detection de vecteur de mouvement d'image selon la revendication 1 ou 2, caracterise par 

un moyen de traitement de pon deration (152) pour determiner un vecteur de mouvement d'un ecran entier a partir 
des coefficients de poids etablis dans chaque region de detection et du vecteur de mouvement de la region de 
detection, jugee etre fiable par le moyen de jugement de fiabilite. 

10. Dispositif de detection de vecteur de mouvement d'image selon la revendication 1, caracterise par 

un moyen de classement (160) pour classer les vecteurs de mouvement en groupes sur la base d'une ampli- 
tude ou d'une direction de leur valeur differentietle, 
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un moyen de jugement de groupe de bouger de camera (161) pour selectionner un groupe pour determiner 
un vecteur de mouvement cf un ecran entier a partir du groupe classe par le moyen de classement, et 

un moyen pour determiner un vecteur de mouvement (162) de I'ecran entier a partir du vecteur de mouvement 
du groupe s£lectionn6 par le moyen de jugement du groupe de bouger de camera. 

11. Dispositil de detection de vecteur de mouvement d'image selon ta revendication 1, caracterts6 par 

Un moyen de classement (172) pour classer les vecteurs de mouvement des regions de detection jugSes etre 
fiables par le moyen de jugement de fiabilite en groupes sur la base d'une amplitude, d'une direction ou de 
ieur valeur differentiells, 

un moyen de jugement de groupe de bouger de camera (173) pour selectionner un groupe pour determiner 
un vecteur de mouvement d'un 6cran entier a partir d'un groupe classe par le moyen de classement, et 

un moyen (1 74) pour determiner un vecteur de mouvement de l'6cran entier a partir du vecteur de mouvement 
du groupe selectionn6 par le moyen de jugement de groupe de bouger de camera. 

12. Dispositil de correction d'osci Nation d'image comprenant : 

un moyen de m6moire de signal d'image ou DTC pour au moins une trame t 

un dispositif de detection de vecteur de mouvement d'image selon au moins Tune quelconque des revendi- 
cations 1 a 11, et 

la lecture de ('emplacement du moyen de m6moire du signal d'image ou du DTC etant commanded sur la 
base d'un vecteur de mouvement detecte par le dispositif de detection de vecteur de mouvement d'image. 
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